-- Logs begin at Mon 2022-07-25 21:42:08 UTC, end at Mon 2022-07-25 23:27:37 UTC. -- Jul 25 22:43:11.341877 dv-cinder-797608-63-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 22:43:11.352564 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 22:43:11 2022] *** Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: nodename: dv-cinder-797608-63-iscsi Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: machine: x86_64 Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: clock source: unix Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: pcre jit disabled Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: detected number of CPU cores: 4 Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: current working directory: / Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: detected binary path: /usr/bin/uwsgi-core Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: your processes number limit is 47680 Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: your memory page size is 4096 bytes Jul 25 22:43:11.354648 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: detected max file descriptor number: 2048 Jul 25 22:43:11.355357 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: lock engine: pthread robust mutexes Jul 25 22:43:11.355357 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: thunder lock: enabled Jul 25 22:43:11.355357 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 22:43:11.355357 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 22:43:11.393681 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: Python main interpreter initialized at 0x55884b2679c0 Jul 25 22:43:11.393681 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: python threads support enabled Jul 25 22:43:11.393681 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: your server socket listen backlog is limited to 100 connections Jul 25 22:43:11.393681 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: your mercy for graceful operations on workers is 90 seconds Jul 25 22:43:11.394083 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 22:43:11.394158 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: *** Operational MODE: preforking *** Jul 25 22:43:11.394383 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: *** uWSGI is running in multiple interpreter mode *** Jul 25 22:43:11.394383 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: spawned uWSGI master process (pid: 80357) Jul 25 22:43:11.394586 dv-cinder-797608-63-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 25 22:43:11.395854 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: spawned uWSGI worker 1 (pid: 80370, cores: 1) Jul 25 22:43:11.395854 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: spawned uWSGI worker 2 (pid: 80371, cores: 1) Jul 25 22:43:11.395854 dv-cinder-797608-63-iscsi devstack@keystone.service[80357]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 22:43:16.988641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:43:16.988641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: from cryptography.utils import int_from_bytes Jul 25 22:43:16.989497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:43:16.989497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: from cryptography.utils import int_from_bytes Jul 25 22:43:16.997253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:43:16.997253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: from cryptography.utils import int_from_bytes Jul 25 22:43:16.997743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:43:16.997743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: from cryptography.utils import int_from_bytes Jul 25 22:43:17.039896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 22:43:17.040087 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 22:43:17.040261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] command line args: [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 22:43:17.040534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 22:43:17.040714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ================================================================================ {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 22:43:17.040970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] admin_token = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.041239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] config_dir = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.045882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.045882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] config_source = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.045882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] debug = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.045882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.045882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.045882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.045882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_config_append = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_dir = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_file = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.046935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.047314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.047314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.047314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.047314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.047525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 22:43:17.047590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.047655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 22:43:17.047655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] command line args: [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 22:43:17.047767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.047836 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 22:43:17.047900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] publish_errors = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.047962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ================================================================================ {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 22:43:17.048020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.048131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] admin_token = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.048261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.048377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] config_dir = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.048480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.048551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.048644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.048850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] config_source = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.048982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.049107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] debug = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.049107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.049421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] standard_threads = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.049560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.049689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.049835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.049968 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.049968 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.050211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.050346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] use_journal = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.050480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.050657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] use_json = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.050788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.050911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] use_stderr = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.051040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_config_append = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.051214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] use_syslog = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.051345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.051479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.051615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_dir = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.051785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.051908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_file = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.052049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.052138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.052138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.052278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.052278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.052746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.053082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.053189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.053189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.053356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.053440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.053513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.053590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.053661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.053661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.053661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.053858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.053931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.054001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.054070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.054140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.054286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.054366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.054443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.054522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.054599 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.054676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.054754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.054832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.054909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.055054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.055156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.055303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.055548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.055629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.055732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] publish_errors = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.055811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.055964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.056044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.056193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.056277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.056370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.056500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.056613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.056747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.056848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.056997 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.057132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] standard_threads = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.057263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.057358 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.057495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.057579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.057728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.057813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.057914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] use_journal = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.058002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.058081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] use_json = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.058206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.058288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] use_stderr = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.058407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] use_syslog = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.058490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.058635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:43:17.058715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.058887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.058973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.059124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.059208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.059363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.059447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.059602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.059685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.059847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.059927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.060081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.060160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.060317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.060402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.060547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.060623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.060775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.060859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.061005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.061083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.061259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.061349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.061493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.061579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.061736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.061813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.061965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.062057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.062201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.062310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.062455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.062560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.062691 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.062808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.062926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.063032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.063171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.063313 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.063453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.063539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.063659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.063742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.063857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.063979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.064062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.064188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.064287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.064445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.064536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.064691 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.064778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.064950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.065048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.065236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.065316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.065427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.065555 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.065643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.065775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.065854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.065938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.066088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.066176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.066318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.066406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.066536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.066615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.066777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.066860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.067022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.067104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.067259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.067342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.067505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.067629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.067735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.067822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.068469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.068622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.068764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.069000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.069282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.069385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.069527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.069608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.069763 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.069843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.069997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.070086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.070230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.070310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.070468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.070547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.070703 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.070794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.070936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.071015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.071169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.071250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.071397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.071484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.071633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.071723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.071868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.071947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.072108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.072265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.072348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.072425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.072559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.072639 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.072794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.072890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.073029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.073132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.073285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.073388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.073513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.073599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.073766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.073891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.074010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.074090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.074241 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.074336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.074479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.074561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.074713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.074795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.074959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.075040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.075192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.075280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.075432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.075510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.075668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.075748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.075903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.075990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.076138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.external = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.076217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.076369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.076448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.076629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.076715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.076872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.076951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.077101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.password = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.080228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.080353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.token = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.080436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.080436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.080565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.080565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.080700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.080779 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.080853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.080929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081467 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.081981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082332 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082733 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.082964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.083092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.083175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.083248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.083320 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.083391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.083463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.083533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.083612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.083715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.084304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.084386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.084466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.084541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.084621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.084695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.084774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.084847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.084919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.084991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.085064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.085164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.085164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.085542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.085630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.085716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.085788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.085856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.external = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.085929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.password = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.token = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.086974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.087090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.087211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.087334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.087448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.087579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.087695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.087808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.087926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.088054 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.088167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.088285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.088414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.088521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.088664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.088751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.088895 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.088997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.089142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.089264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.089380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.089499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.089669 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.089752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.089859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.089962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.090105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.090225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.090357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.090477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.090647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.090764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.090993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.091082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.091239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.091319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.091478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.091558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.091739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.091827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.092022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.092101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.092255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.092334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.092491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.092580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.092725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.092839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.092962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.093050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.093225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.093318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.093455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.093535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.093701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.093781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.093946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.094034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.094181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.094417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.094498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.094659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.094746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.094889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.094976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.095125 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.095272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.095349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.095420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.095580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.095650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.095814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.095895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.096048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.096136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.096283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.096363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.096517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.096603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.096747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.096834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.097059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.097203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.097313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.097394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.097545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.097642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.097789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.097879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.098021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.098252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.098340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.098484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.098563 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.098718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.098800 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.098947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.099037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.099186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.099286 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.099507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.099709 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.099790 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.099975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.100076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.100219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.100323 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.100464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.100565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.100698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.100782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.100927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.101048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.101181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.101343 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.101426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.101581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.101660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.101821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.101944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.102077 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.102163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.102365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.102453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.102585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.102665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.102872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.102953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.103119 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.103267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.103488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.103583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.103669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.103745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.103875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.103956 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.104104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.104183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.104339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.104419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.104566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.104646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.104803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.104883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.105040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.105210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.105290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.105362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.105527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.105608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.105769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.105851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.106013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.106093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.106249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.106335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.106477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.106557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.106707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.106787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.106949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.107029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.107189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.107270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.107420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.107500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.107692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.107779 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.107883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.108003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.108127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.108208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.108461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.108560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.108646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.108720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.108877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.108964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.109176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.109299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.109457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.109534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.109607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.109680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.109838 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.109920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.110078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.110160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.110313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] role.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.110394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.110544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.110623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] role.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.110776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.110856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.111004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.111084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.111251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.111335 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.111493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.111573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.111735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.111814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.111976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.112055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.112217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.112297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.112447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.112528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.112689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.112768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.112939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.113077 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.113178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.113251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.113395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.113493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.113629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.113735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.113983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.114063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.114232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.114416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.114498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.114657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.114739 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.115417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.115753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.115843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.116000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.116136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.116247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.116418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.116497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.116723 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.116804 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.116974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.117167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.117253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.117422 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.117515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.117683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.117763 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.117915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.117995 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.118166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.118254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.118418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.118499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.118665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.118746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.118901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.118989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.119136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.119217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.119366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.119446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.119601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.119689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.119861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.119942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.120107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.120187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.120340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.120429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.120594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.120683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.120836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.120917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] role.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.121072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.121184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] role.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.121342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.121423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.121586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.121665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.121832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.121922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.122068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.122148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.122306 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.122385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.122539 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.122628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.122783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.122864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.123028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.123108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.123258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.123347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.123500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.123580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.123749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.123827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.124001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.124090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.connection = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.124252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.124343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.124497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.124577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.124733 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.124972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.125059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.125261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.125375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.125503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.125635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.125739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.126164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.126294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.126376 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.126450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.126450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.126581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.126662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.126736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.126885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.126966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.127129 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.127209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.127362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.127444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.127604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.127684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.127832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.127912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.128070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.128152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.128302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.128383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.128455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 22:43:17.128581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.128832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.129074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.129346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.129580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.129817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.130057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.130308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.131200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.131484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.131743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.131988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.132239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.132486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.132737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.132977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.133250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.133490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.133740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.133993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.134223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.134470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.134764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.135028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.connection = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.135277 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.135527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.135771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.136015 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.136254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.136494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.136824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.137109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.137338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.137608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.137926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.138169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.138419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.138658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.138906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.139140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.139382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.139619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:43:17.139791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 22:43:17.158431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.158660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.158884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.164443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.164673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.164901 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.167765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.173447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.199191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.199434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.203078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.203309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.252314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.253099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.303387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.303619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.304959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.305228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.369549 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.369712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.369867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.369974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.370102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.370188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.370314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.370398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.370527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.370623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.370744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.370961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.394006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.394126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.394260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.394347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.394490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.394573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.394716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.394808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.394933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.395018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.395145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.395228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.395355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.395448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.406546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.406654 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.419241 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.419475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.419590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.419699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.419785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.419919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.420004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.420184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.420269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.420402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.420484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.420614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.420707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.420828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:43:17.437900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.438106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:43:17.438260 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.438439 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.438539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:43:17.438644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:43:17.438794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.438909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.439000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:43:17.439165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.439249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.439419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.439502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.439669 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.439751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.439988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.450235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.450432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.450522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.450711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.450815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.450988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.451124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.451278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.457955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.458331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.463009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.463222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.463308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.463502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.463588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.463782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.463867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.464061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.464153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.464314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.464410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.464577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.464662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.464840 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.464920 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.465100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.465220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.465391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.465472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.465651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.465732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.465916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.488782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.489141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.490901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.491169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.491277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.491464 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.495814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.496088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.496181 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.496364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.496463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.496641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.503035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.503315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.503400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.503619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.508417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.508519 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.508699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.508782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.508979 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.509069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.509277 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.509360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.509546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.509628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.509818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.509901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.510084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.510166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.510355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.510517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.526677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.526947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.527035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.527223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.531052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.531238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.534388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.534489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.534683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.534783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.539725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.539966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.546159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.546454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.546735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.547022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.547306 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.547449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.547597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.555310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.555602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.555888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.556185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.556455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.556733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.564896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.565200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.565468 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.565727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.572750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.574327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.574604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.577447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.577725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.578020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.578299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.578581 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.580839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.581144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.581417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.581682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.588867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.590262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.590448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.590548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.590727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.590812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.591067 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.591342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.591613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.591895 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.593720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.594005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.594294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.594584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.594871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.607292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.607569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.607846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.608119 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.608224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.608393 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.608665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.608938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.611155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.614152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.617386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.618911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.619198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.619477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.625684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.626072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.627668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.628669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.630705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.631010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.631356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.631631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.631897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.634499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.635986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.636268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.636549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.639725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.640010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.640288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.643266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.644909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.647294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.647568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.647846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.647930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.648128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.648212 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.648413 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.648505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.648683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.648768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.648961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.649276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.649698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.649923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.650208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.650478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.650740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.651021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.656873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.657175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.657460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.664946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:43:17.665246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.665524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.665797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.666089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.666361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.666630 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.666902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.667269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.667551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.667893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.668173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.668440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.668700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:43:17.685853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55884b2679c0 pid: 80370 (default app) Jul 25 22:43:17.689165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112244f-d480-4631-a82d-46ffb30613e5 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:17.689454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112244f-d480-4631-a82d-46ffb30613e5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:17.689728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112244f-d480-4631-a82d-46ffb30613e5 None None] PATH_INFO: `/v3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:17.694348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Mon Jul 25 22:43:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:17.703359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55884b2679c0 pid: 80371 (default app) Jul 25 22:43:26.677822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a83fe8-5ad6-4e7c-be40-ce214403d1d3 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:26.678351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a83fe8-5ad6-4e7c-be40-ce214403d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:26.678655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a83fe8-5ad6-4e7c-be40-ce214403d1d3 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:26.679989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:43:26.687631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:26.688044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:26.688191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:26.761768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: INFO dbcounter [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] Registered counter for database keystone Jul 25 22:43:26.784106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG oslo_db.sqlalchemy.engines [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:43:26.790593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writer thread running {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:43:26.967960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG passlib.handlers.bcrypt [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80371) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 22:43:26.968287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG passlib.handlers.bcrypt [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80371) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 22:43:27.022720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:27.024316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:27.152042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1/3] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 22:43:27.299998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a83fe8-5ad6-4e7c-be40-ce214403d1d3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:27.373989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: INFO dbcounter [None req-e8a83fe8-5ad6-4e7c-be40-ce214403d1d3 None None] Registered counter for database keystone Jul 25 22:43:27.393352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG oslo_db.sqlalchemy.engines [None req-e8a83fe8-5ad6-4e7c-be40-ce214403d1d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:43:27.399770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writer thread running {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:43:27.520490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a83fe8-5ad6-4e7c-be40-ce214403d1d3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:27.525051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe12e57-ba11-4050-b736-8a60cacd76ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:27.525702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12e57-ba11-4050-b736-8a60cacd76ad admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:27.525984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12e57-ba11-4050-b736-8a60cacd76ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:27.526258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12e57-ba11-4050-b736-8a60cacd76ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:27.534702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe12e57-ba11-4050-b736-8a60cacd76ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:27.589202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WARNING keystone.common.rbac_enforcer.enforcer [None req-afe12e57-ba11-4050-b736-8a60cacd76ad admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 22:43:27.589477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe12e57-ba11-4050-b736-8a60cacd76ad admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:27.600099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 3/4] 10.222.0.55 () {58 vars in 1324 bytes} [Mon Jul 25 22:43:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:43:27.606269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:27.621666 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc78041-c263-46e4-8c00-d6a31b103e9e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:27.626135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152669a-dd13-4d7a-89ac-507aab6e07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:27.627276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152669a-dd13-4d7a-89ac-507aab6e07fc admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:27.627563 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152669a-dd13-4d7a-89ac-507aab6e07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:27.627839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152669a-dd13-4d7a-89ac-507aab6e07fc admin admin] PATH_INFO: `/v3/projects/95854b83c1ee4dca86942110e1c80272` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:27.629554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152669a-dd13-4d7a-89ac-507aab6e07fc admin admin] RBAC: Authorizing `identity:get_project(project_id=95854b83c1ee4dca86942110e1c80272)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:27.680071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6152669a-dd13-4d7a-89ac-507aab6e07fc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 22:43:27.680413 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152669a-dd13-4d7a-89ac-507aab6e07fc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:27.685040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 2/5] 10.222.0.55 () {56 vars in 1207 bytes} [Mon Jul 25 22:43:27 2022] GET /identity/v3/projects/95854b83c1ee4dca86942110e1c80272 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:29.667395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959e0a6-5dd5-4de3-ab3f-f3f46363fcd5 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:29.667910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959e0a6-5dd5-4de3-ab3f-f3f46363fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:29.668043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959e0a6-5dd5-4de3-ab3f-f3f46363fcd5 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:29.672281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 4/6] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:43:29.678472 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b95a93-243d-4729-a359-6422597dc4a6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:29.678854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b95a93-243d-4729-a359-6422597dc4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:29.679020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b95a93-243d-4729-a359-6422597dc4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:29.699058 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c6b95a93-243d-4729-a359-6422597dc4a6 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:29.700574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c6b95a93-243d-4729-a359-6422597dc4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:29.708452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 3/7] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 22:43:29.731392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959e0a6-5dd5-4de3-ab3f-f3f46363fcd5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:29.744202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959e0a6-5dd5-4de3-ab3f-f3f46363fcd5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:29.748486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da104f4d-436b-4b3e-af28-ea6dedbfa091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:29.749093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104f4d-436b-4b3e-af28-ea6dedbfa091 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:29.749406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104f4d-436b-4b3e-af28-ea6dedbfa091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:29.749681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104f4d-436b-4b3e-af28-ea6dedbfa091 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:29.757661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da104f4d-436b-4b3e-af28-ea6dedbfa091 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:29.759438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da104f4d-436b-4b3e-af28-ea6dedbfa091 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:29.768292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 5/8] 10.222.0.55 () {58 vars in 1324 bytes} [Mon Jul 25 22:43:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:43:29.774112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b95a93-243d-4729-a359-6422597dc4a6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:29.783279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b95a93-243d-4729-a359-6422597dc4a6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:29.788466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87582201-103d-4399-a257-26e10f8edbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:29.789211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87582201-103d-4399-a257-26e10f8edbaa admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:29.789499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87582201-103d-4399-a257-26e10f8edbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:29.789779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87582201-103d-4399-a257-26e10f8edbaa admin admin] PATH_INFO: `/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:29.791180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87582201-103d-4399-a257-26e10f8edbaa admin admin] RBAC: Authorizing `identity:get_user(user_id=eb5b24c5d3054270abb8dbb4d3ba574a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:29.793073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87582201-103d-4399-a257-26e10f8edbaa admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:29.794656 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 4/9] 10.222.0.55 () {56 vars in 1198 bytes} [Mon Jul 25 22:43:29 2022] GET /identity/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:31.874310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235c41b-ae0f-47ee-b958-93bca347f02b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:31.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235c41b-ae0f-47ee-b958-93bca347f02b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:31.874869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235c41b-ae0f-47ee-b958-93bca347f02b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:31.876209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:31.881888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe16f-7603-441c-a801-b245d2b62d39 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:31.882281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe16f-7603-441c-a801-b245d2b62d39 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:31.882453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe16f-7603-441c-a801-b245d2b62d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:31.895383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613e45-7d77-4e65-80d7-814b410914c4 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:31.895669 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613e45-7d77-4e65-80d7-814b410914c4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:31.896567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613e45-7d77-4e65-80d7-814b410914c4 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:31.898089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 7/11] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:31.903103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-227fe16f-7603-441c-a801-b245d2b62d39 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:31.903366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab1e51-67c0-4951-b9a3-d6209a093cb2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:31.903653 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab1e51-67c0-4951-b9a3-d6209a093cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:31.903929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab1e51-67c0-4951-b9a3-d6209a093cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:31.904308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-227fe16f-7603-441c-a801-b245d2b62d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:31.947142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG passlib.handlers.bcrypt [None req-3eab1e51-67c0-4951-b9a3-d6209a093cb2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80370) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 22:43:31.947559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG passlib.handlers.bcrypt [None req-3eab1e51-67c0-4951-b9a3-d6209a093cb2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80370) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 22:43:31.989893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 5/12] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:43:31.993487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3eab1e51-67c0-4951-b9a3-d6209a093cb2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:31.995091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3eab1e51-67c0-4951-b9a3-d6209a093cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:32.013322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe16f-7603-441c-a801-b245d2b62d39 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:32.037885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:32.097671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 8/13] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:43:32.120146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab1e51-67c0-4951-b9a3-d6209a093cb2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:32.122056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe16f-7603-441c-a801-b245d2b62d39 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:32.157349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df0165-dc88-47d4-9aff-da8ffa31b6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:32.158000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0165-dc88-47d4-9aff-da8ffa31b6ec None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:32.158293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0165-dc88-47d4-9aff-da8ffa31b6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:32.158578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0165-dc88-47d4-9aff-da8ffa31b6ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:32.170548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df0165-dc88-47d4-9aff-da8ffa31b6ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-10df0165-dc88-47d4-9aff-da8ffa31b6ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:32.179647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:32.180646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:43:32.181662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 6/14] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:43:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:43:32.186625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df0165-dc88-47d4-9aff-da8ffa31b6ec None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:32.226109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab1e51-67c0-4951-b9a3-d6209a093cb2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:32.228424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:32.263227 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe675c-ba91-4fe1-b7ab-191f42ccbb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:32.264098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe675c-ba91-4fe1-b7ab-191f42ccbb7a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:32.264383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe675c-ba91-4fe1-b7ab-191f42ccbb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:32.264657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe675c-ba91-4fe1-b7ab-191f42ccbb7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:32.270630 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:32.290535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df0165-dc88-47d4-9aff-da8ffa31b6ec None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:32.327236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fd938-8ad2-4bde-b303-3d67d608e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:32.327914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fd938-8ad2-4bde-b303-3d67d608e053 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:32.328224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fd938-8ad2-4bde-b303-3d67d608e053 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:32.328518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fd938-8ad2-4bde-b303-3d67d608e053 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:32.329327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fd938-8ad2-4bde-b303-3d67d608e053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:32.329639 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fd938-8ad2-4bde-b303-3d67d608e053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:32.331222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fd938-8ad2-4bde-b303-3d67d608e053 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:32.335350 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe675c-ba91-4fe1-b7ab-191f42ccbb7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:32.336878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe675c-ba91-4fe1-b7ab-191f42ccbb7a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:32.344038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 7/15] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:32.350664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fd938-8ad2-4bde-b303-3d67d608e053 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:32.437649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 9/16] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:43:32.443831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe675c-ba91-4fe1-b7ab-191f42ccbb7a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:32.447502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:32.454933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fd938-8ad2-4bde-b303-3d67d608e053 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:32.549996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe675c-ba91-4fe1-b7ab-191f42ccbb7a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:32.588291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66112e7d-492b-4397-bd41-20ee73bfa5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:32.589183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112e7d-492b-4397-bd41-20ee73bfa5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:32.589472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112e7d-492b-4397-bd41-20ee73bfa5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:32.589742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112e7d-492b-4397-bd41-20ee73bfa5b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:32.602214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365b6c5-4698-4ee8-852e-09630783362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:32.602854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365b6c5-4698-4ee8-852e-09630783362e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:32.603134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365b6c5-4698-4ee8-852e-09630783362e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:32.603405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365b6c5-4698-4ee8-852e-09630783362e None admin] PATH_INFO: `/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:32.604583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365b6c5-4698-4ee8-852e-09630783362e None admin] RBAC: Authorizing `identity:get_user(user_id=eb5b24c5d3054270abb8dbb4d3ba574a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:32.606051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365b6c5-4698-4ee8-852e-09630783362e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:32.607641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 8/17] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:32 2022] GET /identity/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:32.608764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66112e7d-492b-4397-bd41-20ee73bfa5b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:32.610291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66112e7d-492b-4397-bd41-20ee73bfa5b4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:32.612893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365b6c5-4698-4ee8-852e-09630783362e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:32.628052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-66112e7d-492b-4397-bd41-20ee73bfa5b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:43:32.628724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:32.629791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:32.631135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:43:32.631135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:43:32.631135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:43:32.631135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:32.631135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 10/18] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:43:32.636503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66112e7d-492b-4397-bd41-20ee73bfa5b4 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:32.693346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:32.714767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365b6c5-4698-4ee8-852e-09630783362e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:32.738390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66112e7d-492b-4397-bd41-20ee73bfa5b4 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:32.748900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333490c4-22d8-446a-8965-93a1d69b1c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:32.749639 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333490c4-22d8-446a-8965-93a1d69b1c7e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:32.749922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333490c4-22d8-446a-8965-93a1d69b1c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:32.750197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333490c4-22d8-446a-8965-93a1d69b1c7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:32.751387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333490c4-22d8-446a-8965-93a1d69b1c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:32.752837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333490c4-22d8-446a-8965-93a1d69b1c7e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:32.754454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 9/19] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:32.761575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333490c4-22d8-446a-8965-93a1d69b1c7e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:32.774068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22f4b5-179a-4be7-9624-13fc7c80b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:32.774701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22f4b5-179a-4be7-9624-13fc7c80b75d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:32.774980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22f4b5-179a-4be7-9624-13fc7c80b75d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:32.775283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22f4b5-179a-4be7-9624-13fc7c80b75d None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:32.775985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22f4b5-179a-4be7-9624-13fc7c80b75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:32.776288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22f4b5-179a-4be7-9624-13fc7c80b75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:32.777719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22f4b5-179a-4be7-9624-13fc7c80b75d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:32.795234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:32.850606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:32.871858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333490c4-22d8-446a-8965-93a1d69b1c7e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:32.910446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c5be1-73dd-42b2-b38f-a389b20baed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:32.911145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c5be1-73dd-42b2-b38f-a389b20baed2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:32.911348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c5be1-73dd-42b2-b38f-a389b20baed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:32.912383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c5be1-73dd-42b2-b38f-a389b20baed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:32.913155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c5be1-73dd-42b2-b38f-a389b20baed2 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.domain.id=default, user.id=eb5b24c5d3054270abb8dbb4d3ba574a) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:32.913469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c5be1-73dd-42b2-b38f-a389b20baed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:32.914946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c5be1-73dd-42b2-b38f-a389b20baed2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:32.922642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1322 bytes} [Mon Jul 25 22:43:32 2022] GET /identity/v3/role_assignments?user.id=eb5b24c5d3054270abb8dbb4d3ba574a&scope.domain.id=default&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:35.307589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81e4a8-525f-4c39-8556-e29962b11049 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:35.308492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81e4a8-525f-4c39-8556-e29962b11049 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:35.308949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81e4a8-525f-4c39-8556-e29962b11049 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:35.310541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:35.316124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1a057-373f-4f14-b46e-d4254f4b9522 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:35.316532 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1a057-373f-4f14-b46e-d4254f4b9522 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:35.316677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1a057-373f-4f14-b46e-d4254f4b9522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:35.326122 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727723e4-834b-4124-b67b-b654c379b578 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:35.326762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727723e4-834b-4124-b67b-b654c379b578 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:35.327246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727723e4-834b-4124-b67b-b654c379b578 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:35.328844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 13/23] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:35.346832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3af1a057-373f-4f14-b46e-d4254f4b9522 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:35.348042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3af1a057-373f-4f14-b46e-d4254f4b9522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:35.359776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177487e-d273-401a-b425-f186affc4c25 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:35.360359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177487e-d273-401a-b425-f186affc4c25 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:35.360832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177487e-d273-401a-b425-f186affc4c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:35.398192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7177487e-d273-401a-b425-f186affc4c25 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:35.399771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7177487e-d273-401a-b425-f186affc4c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:35.454458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 11/24] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:35.502215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1a057-373f-4f14-b46e-d4254f4b9522 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:35.526105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 14/25] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:43:35.569004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177487e-d273-401a-b425-f186affc4c25 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:35.632704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:35.657505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:35.684092 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1a057-373f-4f14-b46e-d4254f4b9522 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:35.729974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177487e-d273-401a-b425-f186affc4c25 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:35.730224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289578b8-4a28-4c9c-95fd-470dbbb5cbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:35.731100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289578b8-4a28-4c9c-95fd-470dbbb5cbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:35.731587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289578b8-4a28-4c9c-95fd-470dbbb5cbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:35.732164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289578b8-4a28-4c9c-95fd-470dbbb5cbd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:35.749798 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289578b8-4a28-4c9c-95fd-470dbbb5cbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:35.751943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289578b8-4a28-4c9c-95fd-470dbbb5cbd8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:35.767035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c40596-a672-40b5-820e-20f9c9379985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:35.768152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c40596-a672-40b5-820e-20f9c9379985 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:35.768634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c40596-a672-40b5-820e-20f9c9379985 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:35.769108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c40596-a672-40b5-820e-20f9c9379985 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-289578b8-4a28-4c9c-95fd-470dbbb5cbd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:43:35.772779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:35.773621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:35.774490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:43:35.774490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:43:35.774490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:43:35.774490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:43:35.774490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 12/26] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:35.775185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f04d4-3208-4a51-a00f-86fead17511b None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:35.775615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f04d4-3208-4a51-a00f-86fead17511b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:35.776048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f04d4-3208-4a51-a00f-86fead17511b None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:35.777835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 13/27] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:35.779069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2c1c-a4c0-4e6f-a469-3fba5dea2add None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:35.779513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2c1c-a4c0-4e6f-a469-3fba5dea2add None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:35.779942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2c1c-a4c0-4e6f-a469-3fba5dea2add None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:35.781345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 14/28] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:35.783635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2c1c-a4c0-4e6f-a469-3fba5dea2add None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:35.795561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c40596-a672-40b5-820e-20f9c9379985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a5c40596-a672-40b5-820e-20f9c9379985 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:35.804130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:35.804976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:35.805839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:35.807124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 15/29] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:43:35.808063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee986d6-c422-4dec-998b-c876d07ace44 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:35.808588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee986d6-c422-4dec-998b-c876d07ace44 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:35.808754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee986d6-c422-4dec-998b-c876d07ace44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:35.830052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1ee986d6-c422-4dec-998b-c876d07ace44 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:35.831366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1ee986d6-c422-4dec-998b-c876d07ace44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:35.920192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 16/30] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:35.921957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea23d9-2b0f-4852-a39a-a9a7d5b0e8d7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:35.922452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea23d9-2b0f-4852-a39a-a9a7d5b0e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:35.923056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea23d9-2b0f-4852-a39a-a9a7d5b0e8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:35.979943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2c1c-a4c0-4e6f-a469-3fba5dea2add None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:36.015284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:36.026889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9382d-b123-4849-9819-1cdb258ff9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:36.027934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9382d-b123-4849-9819-1cdb258ff9ad None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:36.028443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9382d-b123-4849-9819-1cdb258ff9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:36.028919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9382d-b123-4849-9819-1cdb258ff9ad None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:36.030006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9382d-b123-4849-9819-1cdb258ff9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:36.030525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9382d-b123-4849-9819-1cdb258ff9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:36.032190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9382d-b123-4849-9819-1cdb258ff9ad None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:36.053928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 15/31] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:36.055178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9382d-b123-4849-9819-1cdb258ff9ad None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:36.120846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ebea23d9-2b0f-4852-a39a-a9a7d5b0e8d7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:36.126629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ebea23d9-2b0f-4852-a39a-a9a7d5b0e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:36.155829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:36.166730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9382d-b123-4849-9819-1cdb258ff9ad None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:36.200640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 17/32] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:36.202102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea23d9-2b0f-4852-a39a-a9a7d5b0e8d7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:36.202779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bbebf-aa8b-419c-b7ee-ae460a3ad3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:36.203578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bbebf-aa8b-419c-b7ee-ae460a3ad3df None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:36.203999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bbebf-aa8b-419c-b7ee-ae460a3ad3df None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:36.204437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bbebf-aa8b-419c-b7ee-ae460a3ad3df None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:36.205340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bbebf-aa8b-419c-b7ee-ae460a3ad3df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:36.205785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bbebf-aa8b-419c-b7ee-ae460a3ad3df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:36.207338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bbebf-aa8b-419c-b7ee-ae460a3ad3df None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:36.217169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 16/33] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:36.218381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bbebf-aa8b-419c-b7ee-ae460a3ad3df None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:36.281637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:36.316714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea23d9-2b0f-4852-a39a-a9a7d5b0e8d7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:36.330456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bbebf-aa8b-419c-b7ee-ae460a3ad3df None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:36.354695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1002a4-cfac-4d74-964b-0900d0ef8528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:36.355376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1002a4-cfac-4d74-964b-0900d0ef8528 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:36.355735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1002a4-cfac-4d74-964b-0900d0ef8528 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:36.356132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1002a4-cfac-4d74-964b-0900d0ef8528 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:36.356958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1002a4-cfac-4d74-964b-0900d0ef8528 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:36.358482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1002a4-cfac-4d74-964b-0900d0ef8528 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:36.371894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42c6e2-8372-491b-86df-d9f1620d4bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:36.372544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42c6e2-8372-491b-86df-d9f1620d4bb0 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:36.372822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42c6e2-8372-491b-86df-d9f1620d4bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:36.373095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42c6e2-8372-491b-86df-d9f1620d4bb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:36.373823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42c6e2-8372-491b-86df-d9f1620d4bb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:36.378581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42c6e2-8372-491b-86df-d9f1620d4bb0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:36.617797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 18/34] 10.222.0.55 () {60 vars in 1131 bytes} [Mon Jul 25 22:43:36 2022] POST /identity/v3/roles => generated 225 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:43:36.618892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1002a4-cfac-4d74-964b-0900d0ef8528 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:36.687049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:36.690527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 17/35] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:43:36 2022] POST /identity/v3/projects => generated 301 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:43:36.702208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42c6e2-8372-491b-86df-d9f1620d4bb0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:36.861256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1002a4-cfac-4d74-964b-0900d0ef8528 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:36.920729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5d570-43b2-492c-adde-ecb6351585d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:36.922272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d570-43b2-492c-adde-ecb6351585d3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:36.922272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d570-43b2-492c-adde-ecb6351585d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:36.922272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d570-43b2-492c-adde-ecb6351585d3 None admin] PATH_INFO: `/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:36.924703 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5d570-43b2-492c-adde-ecb6351585d3 None admin] RBAC: Authorizing `identity:get_user(user_id=eb5b24c5d3054270abb8dbb4d3ba574a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:36.926709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5d570-43b2-492c-adde-ecb6351585d3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:36.928683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 19/36] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:36 2022] GET /identity/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a => generated 247 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:36.930053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fe233-bef4-4118-8ea0-cbc08a7f3763 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:36.930774 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fe233-bef4-4118-8ea0-cbc08a7f3763 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:36.930774 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fe233-bef4-4118-8ea0-cbc08a7f3763 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:36.932181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 20/37] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:36.932940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5cf15-2570-4ed2-bc68-d097f582c3e1 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:36.933384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5cf15-2570-4ed2-bc68-d097f582c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:36.933697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5cf15-2570-4ed2-bc68-d097f582c3e1 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:36.934894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 21/38] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:36.935965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:36.941601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6185f21-14ef-4a54-9738-a8920831ce3d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:36.941821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6185f21-14ef-4a54-9738-a8920831ce3d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:36.942102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6185f21-14ef-4a54-9738-a8920831ce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:36.943612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42c6e2-8372-491b-86df-d9f1620d4bb0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:36.967849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c6185f21-14ef-4a54-9738-a8920831ce3d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:36.969579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c6185f21-14ef-4a54-9738-a8920831ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:36.996691 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e88d5-ef6d-4098-af7f-de9e53aa9303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:36.997459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e88d5-ef6d-4098-af7f-de9e53aa9303 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:36.997807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e88d5-ef6d-4098-af7f-de9e53aa9303 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:36.998170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e88d5-ef6d-4098-af7f-de9e53aa9303 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:36.999193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e88d5-ef6d-4098-af7f-de9e53aa9303 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:37.000670 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e88d5-ef6d-4098-af7f-de9e53aa9303 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:37.046981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 22/39] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:37.047841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6185f21-14ef-4a54-9738-a8920831ce3d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:37.086000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:37.088284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 18/40] 10.222.0.55 () {60 vars in 1131 bytes} [Mon Jul 25 22:43:36 2022] POST /identity/v3/roles => generated 219 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:43:37.089680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa70aaa-5a46-402a-b148-b4cee1797f73 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:37.090002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa70aaa-5a46-402a-b148-b4cee1797f73 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:37.090259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa70aaa-5a46-402a-b148-b4cee1797f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:37.114605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1aa70aaa-5a46-402a-b148-b4cee1797f73 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:37.116376 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1aa70aaa-5a46-402a-b148-b4cee1797f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:37.170226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6185f21-14ef-4a54-9738-a8920831ce3d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:37.206099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 19/41] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:37.207344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa70aaa-5a46-402a-b148-b4cee1797f73 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:37.213048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89a98-734e-4ad2-9a04-682e8ab10a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:37.214118 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89a98-734e-4ad2-9a04-682e8ab10a0f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:37.214600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89a98-734e-4ad2-9a04-682e8ab10a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:37.215070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89a98-734e-4ad2-9a04-682e8ab10a0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:37.216703 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a89a98-734e-4ad2-9a04-682e8ab10a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:37.219199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a89a98-734e-4ad2-9a04-682e8ab10a0f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:37.221706 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 23/42] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:37.222987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89a98-734e-4ad2-9a04-682e8ab10a0f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:37.321441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:37.331037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa70aaa-5a46-402a-b148-b4cee1797f73 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:37.332310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:37.341934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89a98-734e-4ad2-9a04-682e8ab10a0f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:37.367751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c3de5-0acf-435a-8cfc-cfb4731f309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:37.368380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3de5-0acf-435a-8cfc-cfb4731f309c None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:37.368668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3de5-0acf-435a-8cfc-cfb4731f309c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:37.368948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3de5-0acf-435a-8cfc-cfb4731f309c None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:37.369700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c3de5-0acf-435a-8cfc-cfb4731f309c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:37.371153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c3de5-0acf-435a-8cfc-cfb4731f309c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:37.377328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d065-7be9-485c-8298-482ee17ace2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:37.377980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d065-7be9-485c-8298-482ee17ace2d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:37.378262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d065-7be9-485c-8298-482ee17ace2d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:37.378534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d065-7be9-485c-8298-482ee17ace2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:37.379682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85d065-7be9-485c-8298-482ee17ace2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:37.381803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85d065-7be9-485c-8298-482ee17ace2d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:37.383442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 24/43] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:37.384177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d065-7be9-485c-8298-482ee17ace2d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:37.473406 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 20/44] 10.222.0.55 () {60 vars in 1131 bytes} [Mon Jul 25 22:43:37 2022] POST /identity/v3/roles => generated 223 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:43:37.474159 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c3de5-0acf-435a-8cfc-cfb4731f309c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:37.491025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d065-7be9-485c-8298-482ee17ace2d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:37.534841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf330c1a-274a-4e8d-930b-f7ee6785fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:37.535544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf330c1a-274a-4e8d-930b-f7ee6785fa3e None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:37.535830 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf330c1a-274a-4e8d-930b-f7ee6785fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:37.536112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf330c1a-274a-4e8d-930b-f7ee6785fa3e None admin] PATH_INFO: `/v3/domains/default/users/eb5b24c5d3054270abb8dbb4d3ba574a/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:37.538727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf330c1a-274a-4e8d-930b-f7ee6785fa3e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=eb5b24c5d3054270abb8dbb4d3ba574a, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:37.540307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf330c1a-274a-4e8d-930b-f7ee6785fa3e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:37.588002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c3de5-0acf-435a-8cfc-cfb4731f309c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:37.627408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 25/45] 10.222.0.55 () {58 vars in 1361 bytes} [Mon Jul 25 22:43:37 2022] PUT /identity/v3/domains/default/users/eb5b24c5d3054270abb8dbb4d3ba574a/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:43:37.635104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92f1aa-1e36-4ea4-9b41-a5a7163005cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:37.635760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92f1aa-1e36-4ea4-9b41-a5a7163005cd None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:37.640340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92f1aa-1e36-4ea4-9b41-a5a7163005cd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:37.640340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92f1aa-1e36-4ea4-9b41-a5a7163005cd None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:37.640340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92f1aa-1e36-4ea4-9b41-a5a7163005cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:37.640340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92f1aa-1e36-4ea4-9b41-a5a7163005cd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:37.726929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 21/46] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:43:37 2022] POST /identity/v3/projects => generated 312 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:43:39.672928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8bb07-9900-4129-aaf6-256e396db126 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:39.673488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8bb07-9900-4129-aaf6-256e396db126 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:39.673570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8bb07-9900-4129-aaf6-256e396db126 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:39.674889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 26/47] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:39.681043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd9148-8bf3-40d5-ba97-45082c42f793 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:39.681489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd9148-8bf3-40d5-ba97-45082c42f793 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:39.681652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd9148-8bf3-40d5-ba97-45082c42f793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:39.688028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:39.700585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-10fd9148-8bf3-40d5-ba97-45082c42f793 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:39.706043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-10fd9148-8bf3-40d5-ba97-45082c42f793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:39.769195 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 22/48] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:39.776109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cc18e-0447-4e12-964f-c485b7954dff None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:39.776398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cc18e-0447-4e12-964f-c485b7954dff None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:39.776677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cc18e-0447-4e12-964f-c485b7954dff None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:39.778073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 27/49] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:39.783347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeabc5-c8fd-4c90-8c91-38e42d2e4083 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:39.783643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeabc5-c8fd-4c90-8c91-38e42d2e4083 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:39.783926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeabc5-c8fd-4c90-8c91-38e42d2e4083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:39.793001 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cc18e-0447-4e12-964f-c485b7954dff None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:39.803029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fadeabc5-c8fd-4c90-8c91-38e42d2e4083 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:39.804303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fadeabc5-c8fd-4c90-8c91-38e42d2e4083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:39.814880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:39.873460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 23/50] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:39.896424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeabc5-c8fd-4c90-8c91-38e42d2e4083 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:39.899125 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cc18e-0447-4e12-964f-c485b7954dff None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:39.934565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f430c-ad61-4faf-8456-32ad201601fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:39.935132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f430c-ad61-4faf-8456-32ad201601fa None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:39.935410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f430c-ad61-4faf-8456-32ad201601fa None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:39.935685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f430c-ad61-4faf-8456-32ad201601fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:39.945767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f430c-ad61-4faf-8456-32ad201601fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-0e3f430c-ad61-4faf-8456-32ad201601fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:39.950593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:39.951414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:39.952364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 28/51] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:43:39.957421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f430c-ad61-4faf-8456-32ad201601fa None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:39.958629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:39.998213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeabc5-c8fd-4c90-8c91-38e42d2e4083 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:40.031921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92d6a5-be99-450e-857e-e371e5219b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:40.032791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92d6a5-be99-450e-857e-e371e5219b94 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:40.033093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92d6a5-be99-450e-857e-e371e5219b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:40.033394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92d6a5-be99-450e-857e-e371e5219b94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:40.034624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92d6a5-be99-450e-857e-e371e5219b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:40.036084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92d6a5-be99-450e-857e-e371e5219b94 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:40.036836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:40.038334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 24/52] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:40.044104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92d6a5-be99-450e-857e-e371e5219b94 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:40.055803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f430c-ad61-4faf-8456-32ad201601fa None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:40.089985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31410f55-5eb1-410c-86ff-402ace8b99d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:40.090610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31410f55-5eb1-410c-86ff-402ace8b99d1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:40.090892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31410f55-5eb1-410c-86ff-402ace8b99d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:40.091162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31410f55-5eb1-410c-86ff-402ace8b99d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:40.091870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31410f55-5eb1-410c-86ff-402ace8b99d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:40.092166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31410f55-5eb1-410c-86ff-402ace8b99d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:40.093593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31410f55-5eb1-410c-86ff-402ace8b99d1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:40.105816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 29/53] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:40.111529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31410f55-5eb1-410c-86ff-402ace8b99d1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:40.148039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92d6a5-be99-450e-857e-e371e5219b94 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:40.179520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:40.185328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd71642-0e24-42b7-a61b-207bcc2fc294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:40.185894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd71642-0e24-42b7-a61b-207bcc2fc294 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:40.186178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd71642-0e24-42b7-a61b-207bcc2fc294 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:40.186456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd71642-0e24-42b7-a61b-207bcc2fc294 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:40.187138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd71642-0e24-42b7-a61b-207bcc2fc294 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:40.188760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd71642-0e24-42b7-a61b-207bcc2fc294 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:40.214996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31410f55-5eb1-410c-86ff-402ace8b99d1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:40.248665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e1917-d5aa-4cd7-892a-2403bb25373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:40.249344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e1917-d5aa-4cd7-892a-2403bb25373a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:40.249650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e1917-d5aa-4cd7-892a-2403bb25373a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:40.249928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e1917-d5aa-4cd7-892a-2403bb25373a None admin] PATH_INFO: `/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:40.251101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e1917-d5aa-4cd7-892a-2403bb25373a None admin] RBAC: Authorizing `identity:get_user(user_id=eb5b24c5d3054270abb8dbb4d3ba574a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:40.252574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e1917-d5aa-4cd7-892a-2403bb25373a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:40.254200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 30/54] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:40 2022] GET /identity/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:40.259756 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e1917-d5aa-4cd7-892a-2403bb25373a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:40.272587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:40.299498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 25/55] 10.222.0.55 () {60 vars in 1140 bytes} [Mon Jul 25 22:43:40 2022] POST /identity/v3/projects => generated 298 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:43:40.368645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e1917-d5aa-4cd7-892a-2403bb25373a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:40.405977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf536bc9-d02b-4012-bc33-cdf655902ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:40.406824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536bc9-d02b-4012-bc33-cdf655902ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:40.407157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536bc9-d02b-4012-bc33-cdf655902ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:40.407539 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536bc9-d02b-4012-bc33-cdf655902ee2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:40.408881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf536bc9-d02b-4012-bc33-cdf655902ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:40.410484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf536bc9-d02b-4012-bc33-cdf655902ee2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:40.412851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 31/56] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:40.419386 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd71642-0e24-42b7-a61b-207bcc2fc294 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:40.526581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd71642-0e24-42b7-a61b-207bcc2fc294 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:40.561339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626f4e1-7a5c-4503-b41c-ec0acfdce9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:40.561965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626f4e1-7a5c-4503-b41c-ec0acfdce9df None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:40.562254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626f4e1-7a5c-4503-b41c-ec0acfdce9df None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:40.562538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626f4e1-7a5c-4503-b41c-ec0acfdce9df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:40.563403 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626f4e1-7a5c-4503-b41c-ec0acfdce9df None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.domain.id=default, user.id=eb5b24c5d3054270abb8dbb4d3ba574a) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:40.563811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626f4e1-7a5c-4503-b41c-ec0acfdce9df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:40.565302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626f4e1-7a5c-4503-b41c-ec0acfdce9df None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:40.571873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 26/57] 10.222.0.55 () {56 vars in 1322 bytes} [Mon Jul 25 22:43:40 2022] GET /identity/v3/role_assignments?user.id=eb5b24c5d3054270abb8dbb4d3ba574a&scope.domain.id=default&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:42.557943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7aaa-56e4-4e7b-9045-1fc113436f18 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:42.558467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7aaa-56e4-4e7b-9045-1fc113436f18 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:42.558467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7aaa-56e4-4e7b-9045-1fc113436f18 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:42.559885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 32/58] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:42.565113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f40f40-29fd-4bd9-9b87-9aa7defa6eb6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:42.565517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f40f40-29fd-4bd9-9b87-9aa7defa6eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:42.565707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f40f40-29fd-4bd9-9b87-9aa7defa6eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:42.584017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d8f40f40-29fd-4bd9-9b87-9aa7defa6eb6 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:42.585244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d8f40f40-29fd-4bd9-9b87-9aa7defa6eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:42.630582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:42.654337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 27/59] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:42.678985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b7aaa-56e4-4e7b-9045-1fc113436f18 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:42.758089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:42.780496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b7aaa-56e4-4e7b-9045-1fc113436f18 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:42.815001 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805e9e8-21cd-43c7-ab60-97b51c211742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:42.815572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805e9e8-21cd-43c7-ab60-97b51c211742 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:42.815860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805e9e8-21cd-43c7-ab60-97b51c211742 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:42.816140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805e9e8-21cd-43c7-ab60-97b51c211742 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:42.817353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805e9e8-21cd-43c7-ab60-97b51c211742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:42.819394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805e9e8-21cd-43c7-ab60-97b51c211742 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:42.821023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 33/60] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:42.826631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f40f40-29fd-4bd9-9b87-9aa7defa6eb6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:42.928494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f40f40-29fd-4bd9-9b87-9aa7defa6eb6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:42.963130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a339a-a510-4a0d-917c-6e4bc966ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:42.963747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a339a-a510-4a0d-917c-6e4bc966ef04 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:42.964038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a339a-a510-4a0d-917c-6e4bc966ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:42.964316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a339a-a510-4a0d-917c-6e4bc966ef04 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:42.965010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a339a-a510-4a0d-917c-6e4bc966ef04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:42.966633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a339a-a510-4a0d-917c-6e4bc966ef04 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:43.069936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 28/61] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:43:42 2022] POST /identity/v3/users => generated 275 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:43:46.295628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df634ee8-d456-4b79-af53-0c6333d0be3e None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:46.296616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df634ee8-d456-4b79-af53-0c6333d0be3e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:46.297096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df634ee8-d456-4b79-af53-0c6333d0be3e None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:46.298839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 34/62] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:46.306194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642370-73fe-46cd-bbae-54cabffe28ea None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:46.307153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642370-73fe-46cd-bbae-54cabffe28ea None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:46.307627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642370-73fe-46cd-bbae-54cabffe28ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:46.333553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a0642370-73fe-46cd-bbae-54cabffe28ea None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:46.335235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0642370-73fe-46cd-bbae-54cabffe28ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:46.369269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:46.432125 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 29/63] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:46.478675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df634ee8-d456-4b79-af53-0c6333d0be3e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:46.533696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff505789-d8c0-4a22-a2cc-5d5e14f42877 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:46.534013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff505789-d8c0-4a22-a2cc-5d5e14f42877 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:46.534253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff505789-d8c0-4a22-a2cc-5d5e14f42877 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:46.535951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 30/64] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:46.542096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250477e6-24d3-4f72-b9a9-78980f2fdec8 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:46.542689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250477e6-24d3-4f72-b9a9-78980f2fdec8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:46.543160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250477e6-24d3-4f72-b9a9-78980f2fdec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:46.565233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-250477e6-24d3-4f72-b9a9-78980f2fdec8 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:46.567586 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-250477e6-24d3-4f72-b9a9-78980f2fdec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:46.617769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df634ee8-d456-4b79-af53-0c6333d0be3e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:46.659626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1c132-da64-4844-954a-17146be545f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:46.660517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1c132-da64-4844-954a-17146be545f8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:46.660940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1c132-da64-4844-954a-17146be545f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:46.662170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1c132-da64-4844-954a-17146be545f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:46.671270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 31/65] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:46.672956 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fde6d5-1e11-41a9-9f1f-afb2f2f87229 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:46.673368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fde6d5-1e11-41a9-9f1f-afb2f2f87229 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:46.673770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fde6d5-1e11-41a9-9f1f-afb2f2f87229 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:46.675963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 32/66] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:46.684265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1c132-da64-4844-954a-17146be545f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:46.684492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb17cc-b149-4611-80f0-85cea33aaa0f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:46.684868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb17cc-b149-4611-80f0-85cea33aaa0f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:46.685289 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb17cc-b149-4611-80f0-85cea33aaa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f8e1c132-da64-4844-954a-17146be545f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:46.690507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:46.691445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:46.692175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:46.695321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 35/67] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:46.696923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52491e-f68e-4381-93fa-532d5c266954 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:46.697417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52491e-f68e-4381-93fa-532d5c266954 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:46.697860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52491e-f68e-4381-93fa-532d5c266954 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:46.699317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 36/68] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:46.701998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52491e-f68e-4381-93fa-532d5c266954 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:46.714927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6fcb17cc-b149-4611-80f0-85cea33aaa0f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:46.715389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:46.716284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6fcb17cc-b149-4611-80f0-85cea33aaa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:46.790083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 33/69] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:43:46.798995 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f40cc-c1f0-4d94-9032-cbbf589bcd3e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:46.799293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f40cc-c1f0-4d94-9032-cbbf589bcd3e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:46.799579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f40cc-c1f0-4d94-9032-cbbf589bcd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:46.819719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52491e-f68e-4381-93fa-532d5c266954 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:46.821826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d59f40cc-c1f0-4d94-9032-cbbf589bcd3e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:46.823030 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d59f40cc-c1f0-4d94-9032-cbbf589bcd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:46.843961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:46.862887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669aa6c-abde-4ec9-b156-fe007de2b852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:46.863522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669aa6c-abde-4ec9-b156-fe007de2b852 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:46.863804 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669aa6c-abde-4ec9-b156-fe007de2b852 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:46.864080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669aa6c-abde-4ec9-b156-fe007de2b852 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:46.864862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669aa6c-abde-4ec9-b156-fe007de2b852 None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:46.865191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669aa6c-abde-4ec9-b156-fe007de2b852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:46.866596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669aa6c-abde-4ec9-b156-fe007de2b852 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:46.875345 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 37/70] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:43:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:46.876170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669aa6c-abde-4ec9-b156-fe007de2b852 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:46.899275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 34/71] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:46.900142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f40cc-c1f0-4d94-9032-cbbf589bcd3e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:46.944946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:46.977750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669aa6c-abde-4ec9-b156-fe007de2b852 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.012924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb61cf-ac21-43ed-9672-2167c58f6410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.013469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f40cc-c1f0-4d94-9032-cbbf589bcd3e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.013608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb61cf-ac21-43ed-9672-2167c58f6410 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.013893 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb61cf-ac21-43ed-9672-2167c58f6410 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.014170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb61cf-ac21-43ed-9672-2167c58f6410 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.024742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb61cf-ac21-43ed-9672-2167c58f6410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-6fbb61cf-ac21-43ed-9672-2167c58f6410 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:47.029881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:47.030835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:47.031584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 38/72] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:47.032468 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23595b8-3cae-4d8a-8058-4afe4f1f9b4a None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.032778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23595b8-3cae-4d8a-8058-4afe4f1f9b4a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.033021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23595b8-3cae-4d8a-8058-4afe4f1f9b4a None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.034296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 39/73] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:47.035000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23595b8-3cae-4d8a-8058-4afe4f1f9b4a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.057869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf918-736c-4645-8fee-94520d0fe2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.058512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf918-736c-4645-8fee-94520d0fe2db None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.058798 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf918-736c-4645-8fee-94520d0fe2db None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.059080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf918-736c-4645-8fee-94520d0fe2db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.069909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faf918-736c-4645-8fee-94520d0fe2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-e8faf918-736c-4645-8fee-94520d0fe2db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:47.074686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:47.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:43:47.076305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 35/74] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:43:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:47.076923 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf918-736c-4645-8fee-94520d0fe2db None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.093184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:47.143324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23595b8-3cae-4d8a-8058-4afe4f1f9b4a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.170717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:47.178631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb560a8-d634-42ad-b9e3-525330aab678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.179089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf918-736c-4645-8fee-94520d0fe2db None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.179347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb560a8-d634-42ad-b9e3-525330aab678 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.179637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb560a8-d634-42ad-b9e3-525330aab678 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.179915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb560a8-d634-42ad-b9e3-525330aab678 None admin] PATH_INFO: `/v3/users/94827b7fc9d34f2680ea4bbd23e01217` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.195755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb560a8-d634-42ad-b9e3-525330aab678 None admin] RBAC: Authorizing `identity:get_user(user_id=94827b7fc9d34f2680ea4bbd23e01217)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:47.197284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb560a8-d634-42ad-b9e3-525330aab678 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:47.198992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 40/75] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/users/94827b7fc9d34f2680ea4bbd23e01217 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:47.199763 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb560a8-d634-42ad-b9e3-525330aab678 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.215700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a40d1-48d2-4bf7-8374-f890e415ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.216349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a40d1-48d2-4bf7-8374-f890e415ce80 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.216636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a40d1-48d2-4bf7-8374-f890e415ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.216920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a40d1-48d2-4bf7-8374-f890e415ce80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.228557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a40d1-48d2-4bf7-8374-f890e415ce80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-da0a40d1-48d2-4bf7-8374-f890e415ce80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:47.233479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:47.234447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:43:47.235348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 36/76] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:47.236332 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b79f-c025-416e-9fed-b2088ffef3b3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.236621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b79f-c025-416e-9fed-b2088ffef3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.236905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b79f-c025-416e-9fed-b2088ffef3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.254738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4471b79f-c025-416e-9fed-b2088ffef3b3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:47.255998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4471b79f-c025-416e-9fed-b2088ffef3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:47.306787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb560a8-d634-42ad-b9e3-525330aab678 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.329483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 37/77] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:47.330261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471b79f-c025-416e-9fed-b2088ffef3b3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.333084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:47.346756 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfee4e-855d-491e-a40c-335957876aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.347388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfee4e-855d-491e-a40c-335957876aec None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.347832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfee4e-855d-491e-a40c-335957876aec None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.348112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfee4e-855d-491e-a40c-335957876aec None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.350247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfee4e-855d-491e-a40c-335957876aec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:47.350247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfee4e-855d-491e-a40c-335957876aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:47.351588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfee4e-855d-491e-a40c-335957876aec None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:47.361052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 41/78] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:47.362016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfee4e-855d-491e-a40c-335957876aec None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.412469 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:47.436186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471b79f-c025-416e-9fed-b2088ffef3b3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.465382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfee4e-855d-491e-a40c-335957876aec None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.472097 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d59e5-f106-4a85-80be-46ba50f7b851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.472715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d59e5-f106-4a85-80be-46ba50f7b851 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.472998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d59e5-f106-4a85-80be-46ba50f7b851 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.473306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d59e5-f106-4a85-80be-46ba50f7b851 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.474070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d59e5-f106-4a85-80be-46ba50f7b851 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:47.474378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d59e5-f106-4a85-80be-46ba50f7b851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:47.475760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d59e5-f106-4a85-80be-46ba50f7b851 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:47.483855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 38/79] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:47.484658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d59e5-f106-4a85-80be-46ba50f7b851 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.498796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8142c4-3e3e-4e51-b035-adc5a81ed76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.499451 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8142c4-3e3e-4e51-b035-adc5a81ed76a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.499737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8142c4-3e3e-4e51-b035-adc5a81ed76a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.500018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8142c4-3e3e-4e51-b035-adc5a81ed76a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.548752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:47.572137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8142c4-3e3e-4e51-b035-adc5a81ed76a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:47.573657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8142c4-3e3e-4e51-b035-adc5a81ed76a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:47.591031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d59e5-f106-4a85-80be-46ba50f7b851 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.621170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:47.625178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecfe5d-1870-41a4-9d8b-b623da1938ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.625842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecfe5d-1870-41a4-9d8b-b623da1938ff None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.626090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecfe5d-1870-41a4-9d8b-b623da1938ff None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.626369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecfe5d-1870-41a4-9d8b-b623da1938ff None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.627089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecfe5d-1870-41a4-9d8b-b623da1938ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:47.627399 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecfe5d-1870-41a4-9d8b-b623da1938ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:47.628804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecfe5d-1870-41a4-9d8b-b623da1938ff None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:47.638134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 39/80] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:47.638987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecfe5d-1870-41a4-9d8b-b623da1938ff None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.681174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 42/81] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:43:47.682129 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8142c4-3e3e-4e51-b035-adc5a81ed76a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.746637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecfe5d-1870-41a4-9d8b-b623da1938ff None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.775948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:47.782618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8142c4-3e3e-4e51-b035-adc5a81ed76a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.784715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5550fd-aa09-4a0c-b358-ba0133c4a8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.785390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5550fd-aa09-4a0c-b358-ba0133c4a8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.802716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5550fd-aa09-4a0c-b358-ba0133c4a8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.802716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5550fd-aa09-4a0c-b358-ba0133c4a8d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.802716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5550fd-aa09-4a0c-b358-ba0133c4a8d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:47.802716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5550fd-aa09-4a0c-b358-ba0133c4a8d2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:47.802716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 40/82] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:47.802716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5550fd-aa09-4a0c-b358-ba0133c4a8d2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.822203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f22d61-b7a6-4554-a693-d77492d05bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.822850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f22d61-b7a6-4554-a693-d77492d05bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.823136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f22d61-b7a6-4554-a693-d77492d05bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.823411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f22d61-b7a6-4554-a693-d77492d05bf5 None admin] PATH_INFO: `/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.824584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f22d61-b7a6-4554-a693-d77492d05bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=eb5b24c5d3054270abb8dbb4d3ba574a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:47.826056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f22d61-b7a6-4554-a693-d77492d05bf5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:47.827677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 43/83] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:47.828454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f22d61-b7a6-4554-a693-d77492d05bf5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.851282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:47.896487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5550fd-aa09-4a0c-b358-ba0133c4a8d2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.932830 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d0461-4cbf-4a84-a74d-0b5d1fa94d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.933506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d0461-4cbf-4a84-a74d-0b5d1fa94d93 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.933789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d0461-4cbf-4a84-a74d-0b5d1fa94d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.934069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d0461-4cbf-4a84-a74d-0b5d1fa94d93 None admin] PATH_INFO: `/v3/users/94827b7fc9d34f2680ea4bbd23e01217` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.934434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f22d61-b7a6-4554-a693-d77492d05bf5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:47.935243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d0461-4cbf-4a84-a74d-0b5d1fa94d93 None admin] RBAC: Authorizing `identity:get_user(user_id=94827b7fc9d34f2680ea4bbd23e01217)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:47.936698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d0461-4cbf-4a84-a74d-0b5d1fa94d93 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:47.938342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 41/84] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/users/94827b7fc9d34f2680ea4bbd23e01217 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:47.939113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d0461-4cbf-4a84-a74d-0b5d1fa94d93 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:47.973343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8d473-3707-40d7-a79c-0c52bb873393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:47.974638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8d473-3707-40d7-a79c-0c52bb873393 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:47.974916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8d473-3707-40d7-a79c-0c52bb873393 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:47.975193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8d473-3707-40d7-a79c-0c52bb873393 None admin] PATH_INFO: `/v3/users/94827b7fc9d34f2680ea4bbd23e01217` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:47.976410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8d473-3707-40d7-a79c-0c52bb873393 None admin] RBAC: Authorizing `identity:get_user(user_id=94827b7fc9d34f2680ea4bbd23e01217)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:47.977909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8d473-3707-40d7-a79c-0c52bb873393 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:47.979692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 44/85] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/users/94827b7fc9d34f2680ea4bbd23e01217 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:47.980275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8d473-3707-40d7-a79c-0c52bb873393 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:48.007042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:48.045643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d0461-4cbf-4a84-a74d-0b5d1fa94d93 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:48.069031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:48.080892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bfa5a-59b9-4187-8288-d946a68d9ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:48.081569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bfa5a-59b9-4187-8288-d946a68d9ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:48.081854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bfa5a-59b9-4187-8288-d946a68d9ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:48.082130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bfa5a-59b9-4187-8288-d946a68d9ee7 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:48.083405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bfa5a-59b9-4187-8288-d946a68d9ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:48.084467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8d473-3707-40d7-a79c-0c52bb873393 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:48.085105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bfa5a-59b9-4187-8288-d946a68d9ee7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:48.087000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 42/86] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:47 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:48.087621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bfa5a-59b9-4187-8288-d946a68d9ee7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:48.120367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0082-5999-4bc2-bfe1-e5fe697371ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:48.120921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0082-5999-4bc2-bfe1-e5fe697371ce None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:48.121230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0082-5999-4bc2-bfe1-e5fe697371ce None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:48.121511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0082-5999-4bc2-bfe1-e5fe697371ce None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:48.122201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b0082-5999-4bc2-bfe1-e5fe697371ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:48.123667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b0082-5999-4bc2-bfe1-e5fe697371ce None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:48.191771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bfa5a-59b9-4187-8288-d946a68d9ee7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:48.219610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:48.226019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093814a-2891-4168-b5ff-a5722aa2b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:48.240264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093814a-2891-4168-b5ff-a5722aa2b67b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:48.240264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093814a-2891-4168-b5ff-a5722aa2b67b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:48.240264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093814a-2891-4168-b5ff-a5722aa2b67b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:48.240580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 45/87] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:43:47 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:43:48.240580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0082-5999-4bc2-bfe1-e5fe697371ce None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:48.308785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093814a-2891-4168-b5ff-a5722aa2b67b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:48.310392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093814a-2891-4168-b5ff-a5722aa2b67b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:48.369787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0082-5999-4bc2-bfe1-e5fe697371ce None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:48.421930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8a58a-d63d-4ff3-bc5d-c4f4ecb5452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:48.422495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a58a-d63d-4ff3-bc5d-c4f4ecb5452b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:48.422776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a58a-d63d-4ff3-bc5d-c4f4ecb5452b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:48.423054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a58a-d63d-4ff3-bc5d-c4f4ecb5452b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:48.435171 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 43/88] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:43:48.436620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093814a-2891-4168-b5ff-a5722aa2b67b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:48.436769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:48.478953 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:48.516780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8a58a-d63d-4ff3-bc5d-c4f4ecb5452b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:48.518614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8a58a-d63d-4ff3-bc5d-c4f4ecb5452b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:48.571424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093814a-2891-4168-b5ff-a5722aa2b67b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:48.615413 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab22565-6575-495d-aae6-1d3ff35b2457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:48.616475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab22565-6575-495d-aae6-1d3ff35b2457 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:48.617012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab22565-6575-495d-aae6-1d3ff35b2457 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:48.617950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab22565-6575-495d-aae6-1d3ff35b2457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:48.643375 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 46/89] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:43:48.644332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8a58a-d63d-4ff3-bc5d-c4f4ecb5452b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:48.693633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:48.712280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab22565-6575-495d-aae6-1d3ff35b2457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:48.713937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab22565-6575-495d-aae6-1d3ff35b2457 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:48.753060 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:48.761984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8a58a-d63d-4ff3-bc5d-c4f4ecb5452b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:48.801711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ff159-226c-4795-8c27-6fee0d57d5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:48.803499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff159-226c-4795-8c27-6fee0d57d5ae None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:48.803985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff159-226c-4795-8c27-6fee0d57d5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:48.804563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff159-226c-4795-8c27-6fee0d57d5ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:48.805633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ff159-226c-4795-8c27-6fee0d57d5ae None admin] RBAC: Adding query filter params (role.id=8458ab7384a043d2a03698163d3892fd, scope.project.id=048254d114684a7e8e71048df03aaf23, user.id=94827b7fc9d34f2680ea4bbd23e01217) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:48.806217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ff159-226c-4795-8c27-6fee0d57d5ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:48.807882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ff159-226c-4795-8c27-6fee0d57d5ae None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:48.817048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 47/90] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:43:48 2022] GET /identity/v3/role_assignments?user.id=94827b7fc9d34f2680ea4bbd23e01217&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=8458ab7384a043d2a03698163d3892fd => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:48.818579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ff159-226c-4795-8c27-6fee0d57d5ae None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:48.830135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 44/91] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:43:48.835283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab22565-6575-495d-aae6-1d3ff35b2457 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:48.946898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab22565-6575-495d-aae6-1d3ff35b2457 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:48.948752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ff159-226c-4795-8c27-6fee0d57d5ae None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:48.957526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:48.980138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:48.985845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21697-f5f7-4cd4-87ef-9dbcddc0f66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:48.986535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21697-f5f7-4cd4-87ef-9dbcddc0f66a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:48.986883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21697-f5f7-4cd4-87ef-9dbcddc0f66a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:48.987103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21697-f5f7-4cd4-87ef-9dbcddc0f66a None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:48.988497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e21697-f5f7-4cd4-87ef-9dbcddc0f66a None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:48.993330 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e21697-f5f7-4cd4-87ef-9dbcddc0f66a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:48.994511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45d607-1183-46f6-9219-1fae016dbc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:48.995334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 45/92] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:48 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:48.995662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45d607-1183-46f6-9219-1fae016dbc66 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:48.996120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21697-f5f7-4cd4-87ef-9dbcddc0f66a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:48.996366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45d607-1183-46f6-9219-1fae016dbc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:48.996840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45d607-1183-46f6-9219-1fae016dbc66 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:48.998509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45d607-1183-46f6-9219-1fae016dbc66 None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:49.000224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45d607-1183-46f6-9219-1fae016dbc66 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:49.002260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 48/93] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:48 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:49.003824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45d607-1183-46f6-9219-1fae016dbc66 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:49.124752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45d607-1183-46f6-9219-1fae016dbc66 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:49.141605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21697-f5f7-4cd4-87ef-9dbcddc0f66a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:49.223182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90465b-cf5b-4144-a7e6-f7f20306c22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:49.226557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90465b-cf5b-4144-a7e6-f7f20306c22f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:49.227151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90465b-cf5b-4144-a7e6-f7f20306c22f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:49.227635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90465b-cf5b-4144-a7e6-f7f20306c22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:49.228768 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90465b-cf5b-4144-a7e6-f7f20306c22f None admin] RBAC: Adding query filter params (role.id=0cb8656b530647bea1bc161edf344c96, scope.project.id=048254d114684a7e8e71048df03aaf23, user.id=94827b7fc9d34f2680ea4bbd23e01217) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:49.230667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90465b-cf5b-4144-a7e6-f7f20306c22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:49.234560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90465b-cf5b-4144-a7e6-f7f20306c22f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:49.248022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 49/94] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:43:49 2022] GET /identity/v3/role_assignments?user.id=94827b7fc9d34f2680ea4bbd23e01217&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=0cb8656b530647bea1bc161edf344c96 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:49.249727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90465b-cf5b-4144-a7e6-f7f20306c22f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:49.252303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c25d-9760-4293-bdc2-b288c6d4c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:49.253367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c25d-9760-4293-bdc2-b288c6d4c180 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:49.253855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c25d-9760-4293-bdc2-b288c6d4c180 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:49.256747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c25d-9760-4293-bdc2-b288c6d4c180 None admin] PATH_INFO: `/v3/projects/484fa78f220f44fe81173d4a750ff138` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:49.260799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2c25d-9760-4293-bdc2-b288c6d4c180 None admin] RBAC: Authorizing `identity:get_project(project_id=484fa78f220f44fe81173d4a750ff138)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:49.262779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2c25d-9760-4293-bdc2-b288c6d4c180 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:49.269398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 46/95] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:48 2022] GET /identity/v3/projects/484fa78f220f44fe81173d4a750ff138 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:49.291539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c25d-9760-4293-bdc2-b288c6d4c180 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:49.341153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:49.387863 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:49.487897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c25d-9760-4293-bdc2-b288c6d4c180 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:49.510588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90465b-cf5b-4144-a7e6-f7f20306c22f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:49.561932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd1515-9fd0-437a-ba2d-136cdda3818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:49.562558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd1515-9fd0-437a-ba2d-136cdda3818d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:49.562840 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd1515-9fd0-437a-ba2d-136cdda3818d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:49.563105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd1515-9fd0-437a-ba2d-136cdda3818d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:49.563910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd1515-9fd0-437a-ba2d-136cdda3818d None admin] RBAC: Adding query filter params (role.id=8458ab7384a043d2a03698163d3892fd, scope.project.id=484fa78f220f44fe81173d4a750ff138, user.id=94827b7fc9d34f2680ea4bbd23e01217) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:49.564218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd1515-9fd0-437a-ba2d-136cdda3818d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:49.565710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd1515-9fd0-437a-ba2d-136cdda3818d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:49.575247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2735c-f655-49e1-86e8-3d3d91cabc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:49.575878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2735c-f655-49e1-86e8-3d3d91cabc37 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:49.576157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2735c-f655-49e1-86e8-3d3d91cabc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:49.576426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2735c-f655-49e1-86e8-3d3d91cabc37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:49.577240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2735c-f655-49e1-86e8-3d3d91cabc37 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=048254d114684a7e8e71048df03aaf23, user.id=eb5b24c5d3054270abb8dbb4d3ba574a) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:49.577549 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2735c-f655-49e1-86e8-3d3d91cabc37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:49.578994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2735c-f655-49e1-86e8-3d3d91cabc37 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:49.584747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 47/96] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:43:49 2022] GET /identity/v3/role_assignments?user.id=94827b7fc9d34f2680ea4bbd23e01217&scope.project.id=484fa78f220f44fe81173d4a750ff138&role.id=8458ab7384a043d2a03698163d3892fd => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:49.589187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 50/97] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:43:49 2022] GET /identity/v3/role_assignments?user.id=eb5b24c5d3054270abb8dbb4d3ba574a&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:50.804588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91825885-8403-4c74-a1ad-1d2d2602c02a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:50.805657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91825885-8403-4c74-a1ad-1d2d2602c02a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:50.806156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91825885-8403-4c74-a1ad-1d2d2602c02a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:50.808156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 48/98] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:50.814348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2414695-1f30-41ec-b2ae-5e069b9742d9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:50.815305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2414695-1f30-41ec-b2ae-5e069b9742d9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:50.815783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2414695-1f30-41ec-b2ae-5e069b9742d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:50.850611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b2414695-1f30-41ec-b2ae-5e069b9742d9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:50.852249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b2414695-1f30-41ec-b2ae-5e069b9742d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:50.951747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 51/99] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:43:50.994807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91825885-8403-4c74-a1ad-1d2d2602c02a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:51.040832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470db2f-affd-46fc-a2ca-f3494929023e None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:51.041523 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470db2f-affd-46fc-a2ca-f3494929023e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:51.042584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470db2f-affd-46fc-a2ca-f3494929023e None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:51.044629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 52/100] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:51.050189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9394b9-b8ff-40eb-9049-06291926e78c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:51.050759 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9394b9-b8ff-40eb-9049-06291926e78c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:51.051231 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9394b9-b8ff-40eb-9049-06291926e78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:51.096796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-db9394b9-b8ff-40eb-9049-06291926e78c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:51.096796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-db9394b9-b8ff-40eb-9049-06291926e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:51.127945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:51.141821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91825885-8403-4c74-a1ad-1d2d2602c02a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:51.184531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:51.202397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008103a9-cfe2-4f68-b7cf-5e4364c1f127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:51.203095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 53/101] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:43:51.203209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008103a9-cfe2-4f68-b7cf-5e4364c1f127 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:51.203371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008103a9-cfe2-4f68-b7cf-5e4364c1f127 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:51.203612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008103a9-cfe2-4f68-b7cf-5e4364c1f127 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:51.235335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008103a9-cfe2-4f68-b7cf-5e4364c1f127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:51.237958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9394b9-b8ff-40eb-9049-06291926e78c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-008103a9-cfe2-4f68-b7cf-5e4364c1f127 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:51.241018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:51.241930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:43:51.242774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 49/102] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:51.250115 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008103a9-cfe2-4f68-b7cf-5e4364c1f127 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:51.382992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9394b9-b8ff-40eb-9049-06291926e78c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:51.426518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd67eae-6937-4217-8fc0-b9f4cad99ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:51.432568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd67eae-6937-4217-8fc0-b9f4cad99ada None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:51.432568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd67eae-6937-4217-8fc0-b9f4cad99ada None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:51.433252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd67eae-6937-4217-8fc0-b9f4cad99ada None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:51.434635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd67eae-6937-4217-8fc0-b9f4cad99ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:51.436154 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd67eae-6937-4217-8fc0-b9f4cad99ada None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:51.439433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 54/103] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:51.450088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd67eae-6937-4217-8fc0-b9f4cad99ada None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:51.499017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008103a9-cfe2-4f68-b7cf-5e4364c1f127 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:51.516950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:51.566158 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45973240-0d37-4fc5-9cbb-868ca891733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:51.566815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45973240-0d37-4fc5-9cbb-868ca891733f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:51.567106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45973240-0d37-4fc5-9cbb-868ca891733f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:51.567437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45973240-0d37-4fc5-9cbb-868ca891733f None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:51.568379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45973240-0d37-4fc5-9cbb-868ca891733f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:51.568725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45973240-0d37-4fc5-9cbb-868ca891733f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:51.570188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45973240-0d37-4fc5-9cbb-868ca891733f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:51.587943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 50/104] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:43:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:51.594032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45973240-0d37-4fc5-9cbb-868ca891733f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:51.675221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd67eae-6937-4217-8fc0-b9f4cad99ada None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:51.713512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:51.770919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351166-ee5b-4636-a5f4-a4f8d8602324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:51.771325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45973240-0d37-4fc5-9cbb-868ca891733f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:51.772421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351166-ee5b-4636-a5f4-a4f8d8602324 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:51.772996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351166-ee5b-4636-a5f4-a4f8d8602324 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:51.773509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351166-ee5b-4636-a5f4-a4f8d8602324 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:51.774413 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02351166-ee5b-4636-a5f4-a4f8d8602324 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:51.776095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02351166-ee5b-4636-a5f4-a4f8d8602324 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:51.809979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41bd35-e130-414d-b9ed-bc14de57536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:51.810720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41bd35-e130-414d-b9ed-bc14de57536c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:51.811007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41bd35-e130-414d-b9ed-bc14de57536c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:51.811286 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41bd35-e130-414d-b9ed-bc14de57536c None admin] PATH_INFO: `/v3/users/ce9b42c2f09d4cf8b9797037bdcd3665` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:51.826683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41bd35-e130-414d-b9ed-bc14de57536c None admin] RBAC: Authorizing `identity:get_user(user_id=ce9b42c2f09d4cf8b9797037bdcd3665)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:51.828224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41bd35-e130-414d-b9ed-bc14de57536c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:51.830282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 51/105] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:51 2022] GET /identity/v3/users/ce9b42c2f09d4cf8b9797037bdcd3665 => generated 289 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:51.838218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41bd35-e130-414d-b9ed-bc14de57536c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:51.918828 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 55/106] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:43:51 2022] POST /identity/v3/projects => generated 302 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:43:51.920980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397492f-7c24-413b-b92f-692a7e266cb0 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:51.921505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397492f-7c24-413b-b92f-692a7e266cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:51.922015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397492f-7c24-413b-b92f-692a7e266cb0 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:51.923638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 56/107] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:51.934715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140fa8-5c7c-4fa3-aade-e68357058207 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:51.935313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140fa8-5c7c-4fa3-aade-e68357058207 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:51.935788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140fa8-5c7c-4fa3-aade-e68357058207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:51.956117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41bd35-e130-414d-b9ed-bc14de57536c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:51.975695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-17140fa8-5c7c-4fa3-aade-e68357058207 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:51.977388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-17140fa8-5c7c-4fa3-aade-e68357058207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:51.989196 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:51.996348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c424-e63a-4446-9e31-bc2d34904a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:52.001145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c424-e63a-4446-9e31-bc2d34904a3e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.001145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c424-e63a-4446-9e31-bc2d34904a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.001145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c424-e63a-4446-9e31-bc2d34904a3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.122499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315c424-e63a-4446-9e31-bc2d34904a3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:52.124201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315c424-e63a-4446-9e31-bc2d34904a3e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:52.137112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 57/108] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:52.186681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17140fa8-5c7c-4fa3-aade-e68357058207 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:52.205666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:52.301529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 52/109] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:43:52.310482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c424-e63a-4446-9e31-bc2d34904a3e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:52.333813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:52.413285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17140fa8-5c7c-4fa3-aade-e68357058207 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:52.439374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c424-e63a-4446-9e31-bc2d34904a3e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:52.472478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558ef92-7c6c-4a34-a32b-78db28378f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:52.473274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558ef92-7c6c-4a34-a32b-78db28378f15 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.474157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558ef92-7c6c-4a34-a32b-78db28378f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.474547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558ef92-7c6c-4a34-a32b-78db28378f15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.479766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44589474-784f-47f7-9676-42bee3d612a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:52.480434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44589474-784f-47f7-9676-42bee3d612a8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.480724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44589474-784f-47f7-9676-42bee3d612a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.481009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44589474-784f-47f7-9676-42bee3d612a8 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.482309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44589474-784f-47f7-9676-42bee3d612a8 None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:52.483998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44589474-784f-47f7-9676-42bee3d612a8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:52.485862 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 53/110] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:52 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:52.490471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558ef92-7c6c-4a34-a32b-78db28378f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:52.494157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44589474-784f-47f7-9676-42bee3d612a8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-d558ef92-7c6c-4a34-a32b-78db28378f15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:52.495568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:52.496362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:52.497532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 58/111] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:52.504142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558ef92-7c6c-4a34-a32b-78db28378f15 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:52.589656 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:52.607580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:52.610951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44589474-784f-47f7-9676-42bee3d612a8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:52.651786 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bde5eb-ef06-43ab-b0a5-b65fe69bda8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:52.652552 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bde5eb-ef06-43ab-b0a5-b65fe69bda8d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.652919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bde5eb-ef06-43ab-b0a5-b65fe69bda8d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.653337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bde5eb-ef06-43ab-b0a5-b65fe69bda8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.654216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bde5eb-ef06-43ab-b0a5-b65fe69bda8d None admin] RBAC: Adding query filter params (role.id=dd692b78a44b4d12a6e16b7e98674be3, scope.project.id=048254d114684a7e8e71048df03aaf23, user.id=ce9b42c2f09d4cf8b9797037bdcd3665) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:52.654599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bde5eb-ef06-43ab-b0a5-b65fe69bda8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:52.656179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bde5eb-ef06-43ab-b0a5-b65fe69bda8d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:52.656687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558ef92-7c6c-4a34-a32b-78db28378f15 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:52.664100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 54/112] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:43:52 2022] GET /identity/v3/role_assignments?user.id=ce9b42c2f09d4cf8b9797037bdcd3665&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=dd692b78a44b4d12a6e16b7e98674be3 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:52.714922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d0633-9979-41e3-9f83-ca696f77257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:52.715901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d0633-9979-41e3-9f83-ca696f77257d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.716195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d0633-9979-41e3-9f83-ca696f77257d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.716477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d0633-9979-41e3-9f83-ca696f77257d None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.717262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d0633-9979-41e3-9f83-ca696f77257d None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:52.717578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d0633-9979-41e3-9f83-ca696f77257d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:52.719093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d0633-9979-41e3-9f83-ca696f77257d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:52.736954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 59/113] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:43:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:52.743266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bde5eb-ef06-43ab-b0a5-b65fe69bda8d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:52.796365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1db7-86ce-40cc-be4e-890f58624cae None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.796717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1db7-86ce-40cc-be4e-890f58624cae None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.796924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1db7-86ce-40cc-be4e-890f58624cae None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.798591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 60/114] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:52.814698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55e45b-c4b7-4949-b049-697618cbfcbc None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.815020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55e45b-c4b7-4949-b049-697618cbfcbc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.815261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55e45b-c4b7-4949-b049-697618cbfcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.850393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5e55e45b-c4b7-4949-b049-697618cbfcbc None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:52.851615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5e55e45b-c4b7-4949-b049-697618cbfcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:52.925403 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bde5eb-ef06-43ab-b0a5-b65fe69bda8d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:52.941075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 61/115] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:52.942513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66f1a2-2c86-4dd1-90af-5087db4beaaf None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.942867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66f1a2-2c86-4dd1-90af-5087db4beaaf None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.943208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66f1a2-2c86-4dd1-90af-5087db4beaaf None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.944836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 62/116] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:52.945833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0d5a9-6440-4310-a3c3-58033f32807a None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.950590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0d5a9-6440-4310-a3c3-58033f32807a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.950983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0d5a9-6440-4310-a3c3-58033f32807a None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.952841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 63/117] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:52.953892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ef7bf-2ee1-42a0-8f67-b5772d568516 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.954412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ef7bf-2ee1-42a0-8f67-b5772d568516 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.954760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ef7bf-2ee1-42a0-8f67-b5772d568516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.977074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ea0ef7bf-2ee1-42a0-8f67-b5772d568516 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:52.978409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ea0ef7bf-2ee1-42a0-8f67-b5772d568516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:52.992036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37931db-db88-488c-8090-5631ab503640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:52.992704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37931db-db88-488c-8090-5631ab503640 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.992990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37931db-db88-488c-8090-5631ab503640 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.993303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37931db-db88-488c-8090-5631ab503640 None admin] PATH_INFO: `/v3/users/94827b7fc9d34f2680ea4bbd23e01217` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:52.994576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37931db-db88-488c-8090-5631ab503640 None admin] RBAC: Authorizing `identity:get_user(user_id=94827b7fc9d34f2680ea4bbd23e01217)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:52.996093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37931db-db88-488c-8090-5631ab503640 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:52.998033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 55/118] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:52 2022] GET /identity/v3/users/94827b7fc9d34f2680ea4bbd23e01217 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:52.999026 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2e37-d8f0-4adb-a6d5-9db4b69da74a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:52.999325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2e37-d8f0-4adb-a6d5-9db4b69da74a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:52.999606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2e37-d8f0-4adb-a6d5-9db4b69da74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:53.021037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bb1d2e37-d8f0-4adb-a6d5-9db4b69da74a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:53.022537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bb1d2e37-d8f0-4adb-a6d5-9db4b69da74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:53.026375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:53.054265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:53.068223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 64/119] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:53.073946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ef7bf-2ee1-42a0-8f67-b5772d568516 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:53.118356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 56/120] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:53.119298 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2e37-d8f0-4adb-a6d5-9db4b69da74a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:53.261873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ef7bf-2ee1-42a0-8f67-b5772d568516 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:53.296615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2e37-d8f0-4adb-a6d5-9db4b69da74a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:53.299424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a0c16-db6d-4317-a6c0-9f294bb8d02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:53.300350 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a0c16-db6d-4317-a6c0-9f294bb8d02b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:53.300900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a0c16-db6d-4317-a6c0-9f294bb8d02b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:53.301416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a0c16-db6d-4317-a6c0-9f294bb8d02b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:53.314462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a0c16-db6d-4317-a6c0-9f294bb8d02b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-d49a0c16-db6d-4317-a6c0-9f294bb8d02b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:53.320401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:53.321318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:53.322058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:53.324790 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 65/121] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:53.326022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a0c16-db6d-4317-a6c0-9f294bb8d02b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:53.340436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be62a7-be68-400c-9d51-2521d3894d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:53.341098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be62a7-be68-400c-9d51-2521d3894d18 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:53.341410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be62a7-be68-400c-9d51-2521d3894d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:53.341696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be62a7-be68-400c-9d51-2521d3894d18 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:53.343405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be62a7-be68-400c-9d51-2521d3894d18 None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:53.344637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be62a7-be68-400c-9d51-2521d3894d18 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:53.346631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 57/122] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:53 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:53.347249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be62a7-be68-400c-9d51-2521d3894d18 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:53.366384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:53.396333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:53.448441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a0c16-db6d-4317-a6c0-9f294bb8d02b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:53.471162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be62a7-be68-400c-9d51-2521d3894d18 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:53.497497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb799d-b9f4-4a00-935c-f1e1793a6a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:53.498605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb799d-b9f4-4a00-935c-f1e1793a6a06 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:53.498894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb799d-b9f4-4a00-935c-f1e1793a6a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:53.499173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb799d-b9f4-4a00-935c-f1e1793a6a06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:53.513621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb799d-b9f4-4a00-935c-f1e1793a6a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:53.515131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56080a36-a19d-4aeb-b747-aa97e39133b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:53.516013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56080a36-a19d-4aeb-b747-aa97e39133b3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:53.516503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56080a36-a19d-4aeb-b747-aa97e39133b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:53.516977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56080a36-a19d-4aeb-b747-aa97e39133b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-eedb799d-b9f4-4a00-935c-f1e1793a6a06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:53.518800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:53.519609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 66/123] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:43:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:53.521634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb799d-b9f4-4a00-935c-f1e1793a6a06 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:53.533792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56080a36-a19d-4aeb-b747-aa97e39133b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-56080a36-a19d-4aeb-b747-aa97e39133b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:53.540264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:53.541200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:53.542127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:43:53.545083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 58/124] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:53.546486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56080a36-a19d-4aeb-b747-aa97e39133b3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:53.626103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:53.654153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb799d-b9f4-4a00-935c-f1e1793a6a06 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:53.664974 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56080a36-a19d-4aeb-b747-aa97e39133b3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:53.673488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:53.700137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6f1b6-0c7f-4317-a3da-96925c3029ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:53.700914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6f1b6-0c7f-4317-a3da-96925c3029ce None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:53.701295 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6f1b6-0c7f-4317-a3da-96925c3029ce None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:53.701635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6f1b6-0c7f-4317-a3da-96925c3029ce None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:53.702615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6f1b6-0c7f-4317-a3da-96925c3029ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:53.703001 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6f1b6-0c7f-4317-a3da-96925c3029ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:53.705228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6f1b6-0c7f-4317-a3da-96925c3029ce None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:53.716001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7498210-5c06-4f04-abb7-2e5e74a44206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:53.716537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 67/125] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:53.717170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7498210-5c06-4f04-abb7-2e5e74a44206 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:53.717590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7498210-5c06-4f04-abb7-2e5e74a44206 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:53.717963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6f1b6-0c7f-4317-a3da-96925c3029ce None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:53.718130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7498210-5c06-4f04-abb7-2e5e74a44206 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23/users/94827b7fc9d34f2680ea4bbd23e01217/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:53.720326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7498210-5c06-4f04-abb7-2e5e74a44206 None admin] RBAC: Authorizing `identity:create_grant(project_id=048254d114684a7e8e71048df03aaf23, user_id=94827b7fc9d34f2680ea4bbd23e01217, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:53.724274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7498210-5c06-4f04-abb7-2e5e74a44206 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:53.801401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 59/126] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:43:53 2022] PUT /identity/v3/projects/048254d114684a7e8e71048df03aaf23/users/94827b7fc9d34f2680ea4bbd23e01217/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:43:53.803487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7498210-5c06-4f04-abb7-2e5e74a44206 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:53.843484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6f1b6-0c7f-4317-a3da-96925c3029ce None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:53.882767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b91b15-4444-4b3d-a151-d80cca784410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:53.883835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b91b15-4444-4b3d-a151-d80cca784410 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:53.884318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b91b15-4444-4b3d-a151-d80cca784410 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:53.884789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b91b15-4444-4b3d-a151-d80cca784410 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:53.885903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b91b15-4444-4b3d-a151-d80cca784410 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:53.886414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b91b15-4444-4b3d-a151-d80cca784410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:53.888054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b91b15-4444-4b3d-a151-d80cca784410 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:53.897841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 68/127] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:43:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:53.899126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b91b15-4444-4b3d-a151-d80cca784410 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:53.949797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:54.002056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7498210-5c06-4f04-abb7-2e5e74a44206 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:54.035545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:54.047069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b91b15-4444-4b3d-a151-d80cca784410 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:54.048652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68501eb2-d33c-439e-8126-b933d0461341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:54.050691 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501eb2-d33c-439e-8126-b933d0461341 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.050691 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501eb2-d33c-439e-8126-b933d0461341 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.050691 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501eb2-d33c-439e-8126-b933d0461341 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.051485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68501eb2-d33c-439e-8126-b933d0461341 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:54.053486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68501eb2-d33c-439e-8126-b933d0461341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:54.055272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68501eb2-d33c-439e-8126-b933d0461341 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:54.065375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 60/128] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:43:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:54.066587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68501eb2-d33c-439e-8126-b933d0461341 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:54.099351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748b64-8204-44c6-8b3d-d7f6cc7a3402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:54.100448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748b64-8204-44c6-8b3d-d7f6cc7a3402 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.100955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748b64-8204-44c6-8b3d-d7f6cc7a3402 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.101511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748b64-8204-44c6-8b3d-d7f6cc7a3402 None admin] PATH_INFO: `/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.104356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87748b64-8204-44c6-8b3d-d7f6cc7a3402 None admin] RBAC: Authorizing `identity:get_user(user_id=eb5b24c5d3054270abb8dbb4d3ba574a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:54.106622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87748b64-8204-44c6-8b3d-d7f6cc7a3402 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:54.108589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 69/129] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:53 2022] GET /identity/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:54.109876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748b64-8204-44c6-8b3d-d7f6cc7a3402 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:54.185068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68501eb2-d33c-439e-8126-b933d0461341 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:54.228969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035f564-1e21-4ad3-91a4-b1ecf8a637bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:54.229676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035f564-1e21-4ad3-91a4-b1ecf8a637bd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.229957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035f564-1e21-4ad3-91a4-b1ecf8a637bd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.230234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035f564-1e21-4ad3-91a4-b1ecf8a637bd None admin] PATH_INFO: `/v3/users/94827b7fc9d34f2680ea4bbd23e01217` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.231104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748b64-8204-44c6-8b3d-d7f6cc7a3402 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:54.231538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035f564-1e21-4ad3-91a4-b1ecf8a637bd None admin] RBAC: Authorizing `identity:get_user(user_id=94827b7fc9d34f2680ea4bbd23e01217)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:54.233047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035f564-1e21-4ad3-91a4-b1ecf8a637bd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:54.234944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:54.236759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 61/130] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:54 2022] GET /identity/v3/users/94827b7fc9d34f2680ea4bbd23e01217 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:54.237950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035f564-1e21-4ad3-91a4-b1ecf8a637bd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:54.276376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6f85f-c654-4247-ab35-6ce530d352c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:54.278128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6f85f-c654-4247-ab35-6ce530d352c7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.278584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6f85f-c654-4247-ab35-6ce530d352c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.278994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6f85f-c654-4247-ab35-6ce530d352c7 None admin] PATH_INFO: `/v3/users/94827b7fc9d34f2680ea4bbd23e01217` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.280694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6f85f-c654-4247-ab35-6ce530d352c7 None admin] RBAC: Authorizing `identity:get_user(user_id=94827b7fc9d34f2680ea4bbd23e01217)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:54.282388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6f85f-c654-4247-ab35-6ce530d352c7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:54.284870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 70/131] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:54 2022] GET /identity/v3/users/94827b7fc9d34f2680ea4bbd23e01217 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:54.285877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6f85f-c654-4247-ab35-6ce530d352c7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:54.312534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:54.360626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035f564-1e21-4ad3-91a4-b1ecf8a637bd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:54.399775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a22cd-86fe-4ae7-9c9d-a67aedd9bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:54.400660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a22cd-86fe-4ae7-9c9d-a67aedd9bbef None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.401140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a22cd-86fe-4ae7-9c9d-a67aedd9bbef None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.401554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a22cd-86fe-4ae7-9c9d-a67aedd9bbef None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.403162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a22cd-86fe-4ae7-9c9d-a67aedd9bbef None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:54.404770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a22cd-86fe-4ae7-9c9d-a67aedd9bbef None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:54.405961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6f85f-c654-4247-ab35-6ce530d352c7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:54.406874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 62/132] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:54 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:54.408138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a22cd-86fe-4ae7-9c9d-a67aedd9bbef None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:54.446490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a17ca2-41a6-40ab-937c-58a379735cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:54.447346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a17ca2-41a6-40ab-937c-58a379735cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.447735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a17ca2-41a6-40ab-937c-58a379735cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.448386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a17ca2-41a6-40ab-937c-58a379735cb1 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.453948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a17ca2-41a6-40ab-937c-58a379735cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:54.453948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a17ca2-41a6-40ab-937c-58a379735cb1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:54.454195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 71/133] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:54 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:54.455014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a17ca2-41a6-40ab-937c-58a379735cb1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:54.506151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:54.580033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a17ca2-41a6-40ab-937c-58a379735cb1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:54.604792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a22cd-86fe-4ae7-9c9d-a67aedd9bbef None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:54.647947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8a1ee-806a-418a-a3fd-bd382f40fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:54.648870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8a1ee-806a-418a-a3fd-bd382f40fc6d None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.649315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8a1ee-806a-418a-a3fd-bd382f40fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.649749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8a1ee-806a-418a-a3fd-bd382f40fc6d None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23/users/eb5b24c5d3054270abb8dbb4d3ba574a/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.653209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8a1ee-806a-418a-a3fd-bd382f40fc6d None admin] RBAC: Authorizing `identity:create_grant(project_id=048254d114684a7e8e71048df03aaf23, user_id=eb5b24c5d3054270abb8dbb4d3ba574a, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:54.655835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:54.656185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8a1ee-806a-418a-a3fd-bd382f40fc6d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:54.668333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28712cfb-71bc-49bb-b821-b7d80d6b03c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:54.669017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28712cfb-71bc-49bb-b821-b7d80d6b03c5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.669413 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28712cfb-71bc-49bb-b821-b7d80d6b03c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.669698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28712cfb-71bc-49bb-b821-b7d80d6b03c5 None admin] PATH_INFO: `/v3/projects/484fa78f220f44fe81173d4a750ff138` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.671017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28712cfb-71bc-49bb-b821-b7d80d6b03c5 None admin] RBAC: Authorizing `identity:get_project(project_id=484fa78f220f44fe81173d4a750ff138)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:54.672579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28712cfb-71bc-49bb-b821-b7d80d6b03c5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:54.674582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 63/134] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:54 2022] GET /identity/v3/projects/484fa78f220f44fe81173d4a750ff138 => generated 312 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:54.675616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28712cfb-71bc-49bb-b821-b7d80d6b03c5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:54.782321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 72/135] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:43:54 2022] PUT /identity/v3/projects/048254d114684a7e8e71048df03aaf23/users/eb5b24c5d3054270abb8dbb4d3ba574a/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:43:54.783282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8a1ee-806a-418a-a3fd-bd382f40fc6d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:54.813781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28712cfb-71bc-49bb-b821-b7d80d6b03c5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:54.856516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006904ab-48d4-44e2-af81-910fff616170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:54.857495 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006904ab-48d4-44e2-af81-910fff616170 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.857571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006904ab-48d4-44e2-af81-910fff616170 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.857801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006904ab-48d4-44e2-af81-910fff616170 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23/users/94827b7fc9d34f2680ea4bbd23e01217/roles/0cb8656b530647bea1bc161edf344c96` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.860212 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006904ab-48d4-44e2-af81-910fff616170 None admin] RBAC: Authorizing `identity:create_grant(project_id=048254d114684a7e8e71048df03aaf23, user_id=94827b7fc9d34f2680ea4bbd23e01217, role_id=0cb8656b530647bea1bc161edf344c96)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:54.861768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006904ab-48d4-44e2-af81-910fff616170 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:54.933232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 64/136] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:43:54 2022] PUT /identity/v3/projects/048254d114684a7e8e71048df03aaf23/users/94827b7fc9d34f2680ea4bbd23e01217/roles/0cb8656b530647bea1bc161edf344c96 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:43:54.956879 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60987-4a70-449d-a79e-b548ad025c91 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.957415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60987-4a70-449d-a79e-b548ad025c91 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.957720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60987-4a70-449d-a79e-b548ad025c91 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.959652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 65/137] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:43:54.975994 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeffe4-cd21-4049-8b74-0e07008313bc None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:54.976334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeffe4-cd21-4049-8b74-0e07008313bc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:54.976619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeffe4-cd21-4049-8b74-0e07008313bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:54.996668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:55.001614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8a1ee-806a-418a-a3fd-bd382f40fc6d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:55.009518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2beeffe4-cd21-4049-8b74-0e07008313bc None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:55.016122 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2beeffe4-cd21-4049-8b74-0e07008313bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:55.091742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55bd75-c19a-476b-b7dc-fc99e3818c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:55.092549 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55bd75-c19a-476b-b7dc-fc99e3818c5a None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:55.092840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55bd75-c19a-476b-b7dc-fc99e3818c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:55.093147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55bd75-c19a-476b-b7dc-fc99e3818c5a None admin] PATH_INFO: `/v3/projects/484fa78f220f44fe81173d4a750ff138/users/94827b7fc9d34f2680ea4bbd23e01217/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:55.099332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55bd75-c19a-476b-b7dc-fc99e3818c5a None admin] RBAC: Authorizing `identity:create_grant(project_id=484fa78f220f44fe81173d4a750ff138, user_id=94827b7fc9d34f2680ea4bbd23e01217, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:55.100873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55bd75-c19a-476b-b7dc-fc99e3818c5a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:55.129455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:55.158029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 66/138] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:43:55.187129 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beeffe4-cd21-4049-8b74-0e07008313bc None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:55.214002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 73/139] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:43:54 2022] PUT /identity/v3/projects/484fa78f220f44fe81173d4a750ff138/users/94827b7fc9d34f2680ea4bbd23e01217/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:43:55.339509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beeffe4-cd21-4049-8b74-0e07008313bc None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:55.361487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638af64-11f2-416e-b187-f8aaef317778 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:55.362119 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638af64-11f2-416e-b187-f8aaef317778 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:55.362637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638af64-11f2-416e-b187-f8aaef317778 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:55.364301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 74/140] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:43:55.371365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd3a36-d729-4830-b217-e4843f836b16 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:55.372258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd3a36-d729-4830-b217-e4843f836b16 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:55.372752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd3a36-d729-4830-b217-e4843f836b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:55.398130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-73cd3a36-d729-4830-b217-e4843f836b16 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:55.400236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-73cd3a36-d729-4830-b217-e4843f836b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:55.416945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3cc22-e667-4d27-ba37-a7c93ae2ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:55.417985 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3cc22-e667-4d27-ba37-a7c93ae2ade9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:55.418468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3cc22-e667-4d27-ba37-a7c93ae2ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:55.418966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3cc22-e667-4d27-ba37-a7c93ae2ade9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:55.422377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3cc22-e667-4d27-ba37-a7c93ae2ade9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:55.424231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3cc22-e667-4d27-ba37-a7c93ae2ade9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:55.427840 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 67/141] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:43:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:55.435731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3cc22-e667-4d27-ba37-a7c93ae2ade9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:55.578841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 75/142] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:55.608498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:55.618329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd3a36-d729-4830-b217-e4843f836b16 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:55.716819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3cc22-e667-4d27-ba37-a7c93ae2ade9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:55.765791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd3a36-d729-4830-b217-e4843f836b16 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:55.777512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:55.812147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7acfc-6476-4d03-9b9c-52a42b60255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:55.813526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7acfc-6476-4d03-9b9c-52a42b60255c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:55.814010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7acfc-6476-4d03-9b9c-52a42b60255c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:55.814482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7acfc-6476-4d03-9b9c-52a42b60255c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:55.827217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7acfc-6476-4d03-9b9c-52a42b60255c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5dc7acfc-6476-4d03-9b9c-52a42b60255c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:55.832559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:55.833496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:43:55.834243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:55.836657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 76/143] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:43:55.842914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7acfc-6476-4d03-9b9c-52a42b60255c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:55.845873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dbb0e-4b80-4127-b919-a15bc883e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:55.846523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dbb0e-4b80-4127-b919-a15bc883e416 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:55.846813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dbb0e-4b80-4127-b919-a15bc883e416 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:55.847159 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dbb0e-4b80-4127-b919-a15bc883e416 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:55.847880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dbb0e-4b80-4127-b919-a15bc883e416 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:55.850417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dbb0e-4b80-4127-b919-a15bc883e416 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:55.963090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 68/144] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:43:55 2022] POST /identity/v3/users => generated 283 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:43:55.965631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7acfc-6476-4d03-9b9c-52a42b60255c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:56.009602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4685e5-fdbb-4efe-acbe-39f08fa393b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:56.011165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4685e5-fdbb-4efe-acbe-39f08fa393b7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:56.011727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4685e5-fdbb-4efe-acbe-39f08fa393b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:56.012194 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4685e5-fdbb-4efe-acbe-39f08fa393b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:56.013228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4685e5-fdbb-4efe-acbe-39f08fa393b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:56.013732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4685e5-fdbb-4efe-acbe-39f08fa393b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:56.015480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4685e5-fdbb-4efe-acbe-39f08fa393b7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:56.027241 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 77/145] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:43:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:56.036897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dbb0e-4b80-4127-b919-a15bc883e416 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:56.181970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dbb0e-4b80-4127-b919-a15bc883e416 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:56.197471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:56.233465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bba68-357d-4adc-952a-234ce723febd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:56.234133 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bba68-357d-4adc-952a-234ce723febd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:56.234445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bba68-357d-4adc-952a-234ce723febd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:56.234728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bba68-357d-4adc-952a-234ce723febd None admin] PATH_INFO: `/v3/users/ce9b42c2f09d4cf8b9797037bdcd3665` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:56.237907 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bba68-357d-4adc-952a-234ce723febd None admin] RBAC: Authorizing `identity:get_user(user_id=ce9b42c2f09d4cf8b9797037bdcd3665)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:56.239647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bba68-357d-4adc-952a-234ce723febd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:56.241398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 69/146] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:56 2022] GET /identity/v3/users/ce9b42c2f09d4cf8b9797037bdcd3665 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:56.248186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4685e5-fdbb-4efe-acbe-39f08fa393b7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:56.274173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:56.394065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4685e5-fdbb-4efe-acbe-39f08fa393b7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:56.450691 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f88cdd-947c-4de4-8720-767d21a07da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:56.451582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88cdd-947c-4de4-8720-767d21a07da0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:56.452050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88cdd-947c-4de4-8720-767d21a07da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:56.452479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88cdd-947c-4de4-8720-767d21a07da0 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:56.454255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f88cdd-947c-4de4-8720-767d21a07da0 None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:56.456461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f88cdd-947c-4de4-8720-767d21a07da0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:56.459486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 78/147] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:56 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:56.465420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bba68-357d-4adc-952a-234ce723febd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:56.578012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bba68-357d-4adc-952a-234ce723febd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:56.616144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777839f0-684b-40cd-be25-130b9b2b655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:56.616837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777839f0-684b-40cd-be25-130b9b2b655c None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:56.617151 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777839f0-684b-40cd-be25-130b9b2b655c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:56.617433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777839f0-684b-40cd-be25-130b9b2b655c None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23/users/ce9b42c2f09d4cf8b9797037bdcd3665/roles/dd692b78a44b4d12a6e16b7e98674be3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:56.619481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777839f0-684b-40cd-be25-130b9b2b655c None admin] RBAC: Authorizing `identity:create_grant(project_id=048254d114684a7e8e71048df03aaf23, user_id=ce9b42c2f09d4cf8b9797037bdcd3665, role_id=dd692b78a44b4d12a6e16b7e98674be3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:56.620969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777839f0-684b-40cd-be25-130b9b2b655c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:56.680084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb343c3-1bac-417e-a5ac-e3657e139c60 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:56.680427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb343c3-1bac-417e-a5ac-e3657e139c60 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:56.680714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb343c3-1bac-417e-a5ac-e3657e139c60 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:56.682280 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 79/148] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:43:56.691468 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc752c-1344-4319-8173-ca851ec579e9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:56.691751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc752c-1344-4319-8173-ca851ec579e9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:56.692025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc752c-1344-4319-8173-ca851ec579e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:56.697637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 70/149] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:43:56 2022] PUT /identity/v3/projects/048254d114684a7e8e71048df03aaf23/users/ce9b42c2f09d4cf8b9797037bdcd3665/roles/dd692b78a44b4d12a6e16b7e98674be3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:43:56.723235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e5dc752c-1344-4319-8173-ca851ec579e9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:56.725056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e5dc752c-1344-4319-8173-ca851ec579e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:56.829782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 80/150] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:43:56.885480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777839f0-684b-40cd-be25-130b9b2b655c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:56.934693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:57.025177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777839f0-684b-40cd-be25-130b9b2b655c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:57.075476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fce45e-4293-4e84-b8f8-94f3594f2cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:57.076200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fce45e-4293-4e84-b8f8-94f3594f2cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:57.076475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fce45e-4293-4e84-b8f8-94f3594f2cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:57.076788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fce45e-4293-4e84-b8f8-94f3594f2cf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:57.091844 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fce45e-4293-4e84-b8f8-94f3594f2cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-a6fce45e-4293-4e84-b8f8-94f3594f2cf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:57.097281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:57.098102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:43:57.100395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 71/151] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:57.107932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc752c-1344-4319-8173-ca851ec579e9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:57.123083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:57.241865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc752c-1344-4319-8173-ca851ec579e9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:57.288829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9231ac-fd53-4b53-8c5b-c24517ca5a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:57.289848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9231ac-fd53-4b53-8c5b-c24517ca5a6c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:57.290322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9231ac-fd53-4b53-8c5b-c24517ca5a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:57.290815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9231ac-fd53-4b53-8c5b-c24517ca5a6c None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:57.291737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9231ac-fd53-4b53-8c5b-c24517ca5a6c None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:57.292252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9231ac-fd53-4b53-8c5b-c24517ca5a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:57.293901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9231ac-fd53-4b53-8c5b-c24517ca5a6c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:57.307493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 81/152] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:43:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:57.315275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fce45e-4293-4e84-b8f8-94f3594f2cf2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:57.469605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:57.476198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fce45e-4293-4e84-b8f8-94f3594f2cf2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:57.523436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66891f-5f6b-439f-af6e-98cd58533378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:57.524102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66891f-5f6b-439f-af6e-98cd58533378 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:57.524391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66891f-5f6b-439f-af6e-98cd58533378 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:57.524670 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66891f-5f6b-439f-af6e-98cd58533378 None admin] PATH_INFO: `/v3/users/94827b7fc9d34f2680ea4bbd23e01217` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:57.526016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66891f-5f6b-439f-af6e-98cd58533378 None admin] RBAC: Authorizing `identity:get_user(user_id=94827b7fc9d34f2680ea4bbd23e01217)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:57.527520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66891f-5f6b-439f-af6e-98cd58533378 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:57.529265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 72/153] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:57 2022] GET /identity/v3/users/94827b7fc9d34f2680ea4bbd23e01217 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:57.535143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9231ac-fd53-4b53-8c5b-c24517ca5a6c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:57.674145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:57.715972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9231ac-fd53-4b53-8c5b-c24517ca5a6c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:57.759639 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfc190-7784-48aa-a18b-ed316d947826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:57.760610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfc190-7784-48aa-a18b-ed316d947826 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:57.761083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfc190-7784-48aa-a18b-ed316d947826 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:57.761588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfc190-7784-48aa-a18b-ed316d947826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:57.868898 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfc190-7784-48aa-a18b-ed316d947826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:57.870764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfc190-7784-48aa-a18b-ed316d947826 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:57.952014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:57.987159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 82/154] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:43:57.993286 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66891f-5f6b-439f-af6e-98cd58533378 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:58.043748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7685-270d-410d-8b2f-f001fce4c707 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:58.044360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7685-270d-410d-8b2f-f001fce4c707 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:58.044847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7685-270d-410d-8b2f-f001fce4c707 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:58.046493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 83/155] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:58.059254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e339db4-1838-448a-bd7d-e903dd046f83 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:58.059861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e339db4-1838-448a-bd7d-e903dd046f83 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:58.060390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e339db4-1838-448a-bd7d-e903dd046f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:58.096830 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1e339db4-1838-448a-bd7d-e903dd046f83 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:58.098550 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1e339db4-1838-448a-bd7d-e903dd046f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:58.152550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66891f-5f6b-439f-af6e-98cd58533378 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:58.204802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a525fa2-9d5f-4e0d-810e-9ae98ba40885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:58.208486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525fa2-9d5f-4e0d-810e-9ae98ba40885 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:58.208486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525fa2-9d5f-4e0d-810e-9ae98ba40885 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:58.208486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525fa2-9d5f-4e0d-810e-9ae98ba40885 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:58.209890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a525fa2-9d5f-4e0d-810e-9ae98ba40885 None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:58.211539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a525fa2-9d5f-4e0d-810e-9ae98ba40885 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:58.213755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 73/156] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:43:57 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:58.219631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a525fa2-9d5f-4e0d-810e-9ae98ba40885 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:58.250470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 84/157] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:43:58.290646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e339db4-1838-448a-bd7d-e903dd046f83 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:58.297216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:58.372187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a525fa2-9d5f-4e0d-810e-9ae98ba40885 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:58.427638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd11dd-eecf-4066-90e4-b8c36c2e3155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:58.428614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd11dd-eecf-4066-90e4-b8c36c2e3155 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:58.428830 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd11dd-eecf-4066-90e4-b8c36c2e3155 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:58.429023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd11dd-eecf-4066-90e4-b8c36c2e3155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:58.429892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd11dd-eecf-4066-90e4-b8c36c2e3155 None admin] RBAC: Adding query filter params (role.id=8458ab7384a043d2a03698163d3892fd, scope.project.id=048254d114684a7e8e71048df03aaf23, user.id=94827b7fc9d34f2680ea4bbd23e01217) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:58.430182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd11dd-eecf-4066-90e4-b8c36c2e3155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:58.431851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd11dd-eecf-4066-90e4-b8c36c2e3155 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:58.438896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 74/158] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:43:58 2022] GET /identity/v3/role_assignments?user.id=94827b7fc9d34f2680ea4bbd23e01217&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=8458ab7384a043d2a03698163d3892fd => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:43:58.462019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18f1f9-b3ea-48b8-8fea-591e7d5f9a7e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:58.462327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18f1f9-b3ea-48b8-8fea-591e7d5f9a7e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:58.462626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18f1f9-b3ea-48b8-8fea-591e7d5f9a7e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:58.464023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 75/159] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:43:58.475564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48d4fb-54b4-4cfb-aab8-a869f0496068 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:58.475874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48d4fb-54b4-4cfb-aab8-a869f0496068 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:58.476127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48d4fb-54b4-4cfb-aab8-a869f0496068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:58.483975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e339db4-1838-448a-bd7d-e903dd046f83 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:58.490899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:58.525540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2e48d4fb-54b4-4cfb-aab8-a869f0496068 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:58.525540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2e48d4fb-54b4-4cfb-aab8-a869f0496068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:58.563023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd78a8-efba-476e-8e65-4c6f4b40504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:58.563620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd78a8-efba-476e-8e65-4c6f4b40504b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:58.563904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd78a8-efba-476e-8e65-4c6f4b40504b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:58.564184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd78a8-efba-476e-8e65-4c6f4b40504b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:58.596645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd78a8-efba-476e-8e65-4c6f4b40504b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a6fd78a8-efba-476e-8e65-4c6f4b40504b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:58.602307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:58.603311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:58.604542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 85/160] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:43:58.611894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd78a8-efba-476e-8e65-4c6f4b40504b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:58.640055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 76/161] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:43:58.691970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48d4fb-54b4-4cfb-aab8-a869f0496068 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:58.756729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:58.790100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd78a8-efba-476e-8e65-4c6f4b40504b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:58.860108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8934c-cb7d-41b7-91c5-f4ab1c83303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:58.860108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8934c-cb7d-41b7-91c5-f4ab1c83303c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:58.860108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8934c-cb7d-41b7-91c5-f4ab1c83303c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:58.860108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8934c-cb7d-41b7-91c5-f4ab1c83303c None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:58.860462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8934c-cb7d-41b7-91c5-f4ab1c83303c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:58.860462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8934c-cb7d-41b7-91c5-f4ab1c83303c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:58.866627 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8934c-cb7d-41b7-91c5-f4ab1c83303c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:58.880760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 86/162] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:58.887407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8934c-cb7d-41b7-91c5-f4ab1c83303c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:58.916198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48d4fb-54b4-4cfb-aab8-a869f0496068 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:58.955986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:59.002760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7f208-b787-4269-88a5-b19cf7218e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:59.003431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7f208-b787-4269-88a5-b19cf7218e6f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:59.003714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7f208-b787-4269-88a5-b19cf7218e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:59.003992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7f208-b787-4269-88a5-b19cf7218e6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:59.020778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7f208-b787-4269-88a5-b19cf7218e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-09a7f208-b787-4269-88a5-b19cf7218e6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:59.034299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:59.035190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:43:59.037466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 77/163] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:43:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:59.038831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f7acf-33b7-4f8e-abc8-7faafda3ec6a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:59.038831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f7acf-33b7-4f8e-abc8-7faafda3ec6a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:59.038831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f7acf-33b7-4f8e-abc8-7faafda3ec6a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:59.040818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 78/164] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:59.046927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0dbf-05de-47f3-96b0-aee19456ad99 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:59.047226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0dbf-05de-47f3-96b0-aee19456ad99 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:59.047510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0dbf-05de-47f3-96b0-aee19456ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:59.074782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ba0a0dbf-05de-47f3-96b0-aee19456ad99 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:59.076020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ba0a0dbf-05de-47f3-96b0-aee19456ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:59.174478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8934c-cb7d-41b7-91c5-f4ab1c83303c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:59.218586 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 79/165] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:43:59.220047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a0dbf-05de-47f3-96b0-aee19456ad99 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:59.258802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f485d38-8a6a-4574-9e2a-5006dbaaa056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:59.259939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f485d38-8a6a-4574-9e2a-5006dbaaa056 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:59.260438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f485d38-8a6a-4574-9e2a-5006dbaaa056 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:59.260931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f485d38-8a6a-4574-9e2a-5006dbaaa056 None admin] PATH_INFO: `/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:59.266854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f485d38-8a6a-4574-9e2a-5006dbaaa056 None admin] RBAC: Authorizing `identity:get_user(user_id=eb5b24c5d3054270abb8dbb4d3ba574a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:59.269684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f485d38-8a6a-4574-9e2a-5006dbaaa056 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:59.272958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 87/166] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:58 2022] GET /identity/v3/users/eb5b24c5d3054270abb8dbb4d3ba574a => generated 247 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:59.277201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f485d38-8a6a-4574-9e2a-5006dbaaa056 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:59.299450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:59.424148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a0dbf-05de-47f3-96b0-aee19456ad99 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:59.475337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762c971-e85a-4345-bc79-d58d57eab432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:59.475897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c971-e85a-4345-bc79-d58d57eab432 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:59.476184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c971-e85a-4345-bc79-d58d57eab432 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:59.476463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c971-e85a-4345-bc79-d58d57eab432 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:59.483120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762c971-e85a-4345-bc79-d58d57eab432 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:59.483535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762c971-e85a-4345-bc79-d58d57eab432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:59.484999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762c971-e85a-4345-bc79-d58d57eab432 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:59.508253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 80/167] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:43:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:59.509044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762c971-e85a-4345-bc79-d58d57eab432 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:59.511129 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:59.537762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f485d38-8a6a-4574-9e2a-5006dbaaa056 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:59.625274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61e459-75da-4a72-9a5a-2e51905a2ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:59.625946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e459-75da-4a72-9a5a-2e51905a2ded None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:59.626229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e459-75da-4a72-9a5a-2e51905a2ded None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:59.626507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e459-75da-4a72-9a5a-2e51905a2ded None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:59.664692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61e459-75da-4a72-9a5a-2e51905a2ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-bd61e459-75da-4a72-9a5a-2e51905a2ded None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:43:59.676333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:59.679692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:43:59.685900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:43:59.687742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 88/168] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:43:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:59.688654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61e459-75da-4a72-9a5a-2e51905a2ded None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:59.769704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:59.814924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762c971-e85a-4345-bc79-d58d57eab432 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:59.890875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61e459-75da-4a72-9a5a-2e51905a2ded None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:59.900243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b733b-5287-41d1-ae1d-da9524bfb72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:59.901261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b733b-5287-41d1-ae1d-da9524bfb72b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:59.901852 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b733b-5287-41d1-ae1d-da9524bfb72b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:59.902299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b733b-5287-41d1-ae1d-da9524bfb72b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:59.938747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657ef0f-b3d3-407a-8a5c-ea9804b863cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:59.939417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ef0f-b3d3-407a-8a5c-ea9804b863cd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:59.939701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ef0f-b3d3-407a-8a5c-ea9804b863cd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:59.939985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ef0f-b3d3-407a-8a5c-ea9804b863cd None admin] PATH_INFO: `/v3/users/94827b7fc9d34f2680ea4bbd23e01217` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:59.941229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657ef0f-b3d3-407a-8a5c-ea9804b863cd None admin] RBAC: Authorizing `identity:get_user(user_id=94827b7fc9d34f2680ea4bbd23e01217)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:59.943323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657ef0f-b3d3-407a-8a5c-ea9804b863cd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:59.945347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 89/169] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:43:59 2022] GET /identity/v3/users/94827b7fc9d34f2680ea4bbd23e01217 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:59.945921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657ef0f-b3d3-407a-8a5c-ea9804b863cd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:59.982191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:00.045480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b733b-5287-41d1-ae1d-da9524bfb72b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:00.048034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b733b-5287-41d1-ae1d-da9524bfb72b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:00.148200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657ef0f-b3d3-407a-8a5c-ea9804b863cd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:00.255742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:00.256832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422c7cc-285d-444d-8c99-a20c815d10ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:00.257498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422c7cc-285d-444d-8c99-a20c815d10ca None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:00.257769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422c7cc-285d-444d-8c99-a20c815d10ca None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:00.258056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422c7cc-285d-444d-8c99-a20c815d10ca None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:00.258768 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422c7cc-285d-444d-8c99-a20c815d10ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:00.259068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422c7cc-285d-444d-8c99-a20c815d10ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:00.260480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422c7cc-285d-444d-8c99-a20c815d10ca None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:00.280451 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 90/170] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:43:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:00.285173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422c7cc-285d-444d-8c99-a20c815d10ca None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:00.313678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 81/171] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:00.315009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b733b-5287-41d1-ae1d-da9524bfb72b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:00.450262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:00.491987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422c7cc-285d-444d-8c99-a20c815d10ca None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:00.508685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b733b-5287-41d1-ae1d-da9524bfb72b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:00.554984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3bbb0-3a5f-45df-88e5-34a4f21c3e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:00.555997 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3bbb0-3a5f-45df-88e5-34a4f21c3e1a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:00.558220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3bbb0-3a5f-45df-88e5-34a4f21c3e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:00.558743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3bbb0-3a5f-45df-88e5-34a4f21c3e1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:00.585188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd48a89-8216-4dfc-8eb6-cad70e523e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:00.586200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd48a89-8216-4dfc-8eb6-cad70e523e8c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:00.586698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd48a89-8216-4dfc-8eb6-cad70e523e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:00.587193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd48a89-8216-4dfc-8eb6-cad70e523e8c None admin] PATH_INFO: `/v3/users/94827b7fc9d34f2680ea4bbd23e01217` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:00.589881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd48a89-8216-4dfc-8eb6-cad70e523e8c None admin] RBAC: Authorizing `identity:get_user(user_id=94827b7fc9d34f2680ea4bbd23e01217)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:00.591653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd48a89-8216-4dfc-8eb6-cad70e523e8c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:00.594220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 82/172] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:00 2022] GET /identity/v3/users/94827b7fc9d34f2680ea4bbd23e01217 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:00.596249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd48a89-8216-4dfc-8eb6-cad70e523e8c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:00.657683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:00.699049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3bbb0-3a5f-45df-88e5-34a4f21c3e1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:00.700713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3bbb0-3a5f-45df-88e5-34a4f21c3e1a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:00.717933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd48a89-8216-4dfc-8eb6-cad70e523e8c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:00.755423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bded3-7043-4d4f-9e0c-340e8df29307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:00.756504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bded3-7043-4d4f-9e0c-340e8df29307 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:00.757026 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bded3-7043-4d4f-9e0c-340e8df29307 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:00.757572 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bded3-7043-4d4f-9e0c-340e8df29307 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:00.759085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bded3-7043-4d4f-9e0c-340e8df29307 None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:00.760797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bded3-7043-4d4f-9e0c-340e8df29307 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:00.762781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 83/173] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:00 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:00.763800 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bded3-7043-4d4f-9e0c-340e8df29307 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:00.857165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:00.888942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bded3-7043-4d4f-9e0c-340e8df29307 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:00.903836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 91/174] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:00.904713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3bbb0-3a5f-45df-88e5-34a4f21c3e1a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:00.913599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:00.939731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f90f1-f987-452d-8f6e-7d7fb3e82e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:00.940400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f90f1-f987-452d-8f6e-7d7fb3e82e02 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:00.940706 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f90f1-f987-452d-8f6e-7d7fb3e82e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:00.940978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f90f1-f987-452d-8f6e-7d7fb3e82e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.102284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f90f1-f987-452d-8f6e-7d7fb3e82e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:01.104778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f90f1-f987-452d-8f6e-7d7fb3e82e02 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:01.117199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3bbb0-3a5f-45df-88e5-34a4f21c3e1a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:01.171276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5d035-fcd0-4d83-b2cc-8c40c1395b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:01.171918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5d035-fcd0-4d83-b2cc-8c40c1395b83 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.172196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5d035-fcd0-4d83-b2cc-8c40c1395b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.172465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5d035-fcd0-4d83-b2cc-8c40c1395b83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.173617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5d035-fcd0-4d83-b2cc-8c40c1395b83 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=048254d114684a7e8e71048df03aaf23, user.id=eb5b24c5d3054270abb8dbb4d3ba574a) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:01.173949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5d035-fcd0-4d83-b2cc-8c40c1395b83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:01.177007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5d035-fcd0-4d83-b2cc-8c40c1395b83 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:01.184964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 92/175] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:00 2022] GET /identity/v3/role_assignments?user.id=eb5b24c5d3054270abb8dbb4d3ba574a&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:01.186159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5d035-fcd0-4d83-b2cc-8c40c1395b83 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:01.282074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:01.311090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 84/176] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:01.312467 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb0b4-f9a3-48bc-a3ad-c73009dea167 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.312749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb0b4-f9a3-48bc-a3ad-c73009dea167 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.313027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb0b4-f9a3-48bc-a3ad-c73009dea167 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.314771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 85/177] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:01.315957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a80b67-008d-4574-a193-e5d258fb0234 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.316209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a80b67-008d-4574-a193-e5d258fb0234 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.316605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a80b67-008d-4574-a193-e5d258fb0234 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.319882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 86/178] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:01.321598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286fcd8-b66b-4bd7-8f1d-4b44f6ac2275 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.322068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286fcd8-b66b-4bd7-8f1d-4b44f6ac2275 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.322528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286fcd8-b66b-4bd7-8f1d-4b44f6ac2275 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.326637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 87/179] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:01.327949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286fcd8-b66b-4bd7-8f1d-4b44f6ac2275 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:01.353369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:01.371426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5d035-fcd0-4d83-b2cc-8c40c1395b83 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:01.420322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0bfdb-871b-4eb4-902d-2aa1263f24ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:01.421002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bfdb-871b-4eb4-902d-2aa1263f24ab None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.421363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bfdb-871b-4eb4-902d-2aa1263f24ab None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.421619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bfdb-871b-4eb4-902d-2aa1263f24ab None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.422881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0bfdb-871b-4eb4-902d-2aa1263f24ab None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:01.424395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0bfdb-871b-4eb4-902d-2aa1263f24ab None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:01.427048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 93/180] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:01 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:01.432715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155f137-324a-43a2-83bb-e9f77aa96ed7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.432715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155f137-324a-43a2-83bb-e9f77aa96ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.432715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155f137-324a-43a2-83bb-e9f77aa96ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.449337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6155f137-324a-43a2-83bb-e9f77aa96ed7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:01.451135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6155f137-324a-43a2-83bb-e9f77aa96ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:01.482992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286fcd8-b66b-4bd7-8f1d-4b44f6ac2275 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:01.520997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88300c63-d31a-4cee-8fbe-4c6ae47790fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:01.521783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88300c63-d31a-4cee-8fbe-4c6ae47790fb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.522061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88300c63-d31a-4cee-8fbe-4c6ae47790fb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.522334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88300c63-d31a-4cee-8fbe-4c6ae47790fb None admin] PATH_INFO: `/v3/projects/484fa78f220f44fe81173d4a750ff138` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.523553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88300c63-d31a-4cee-8fbe-4c6ae47790fb None admin] RBAC: Authorizing `identity:get_project(project_id=484fa78f220f44fe81173d4a750ff138)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:01.525010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88300c63-d31a-4cee-8fbe-4c6ae47790fb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:01.526974 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 88/181] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:01 2022] GET /identity/v3/projects/484fa78f220f44fe81173d4a750ff138 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:01.527922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a037d6-33e8-47f8-912b-30667a01bd43 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.528200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a037d6-33e8-47f8-912b-30667a01bd43 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.528470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a037d6-33e8-47f8-912b-30667a01bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.540626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 94/182] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:01.540626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639ba17-432d-4acb-9ecd-0eee39848d71 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.540626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639ba17-432d-4acb-9ecd-0eee39848d71 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.540626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639ba17-432d-4acb-9ecd-0eee39848d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.552737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-47a037d6-33e8-47f8-912b-30667a01bd43 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:01.554224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-47a037d6-33e8-47f8-912b-30667a01bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:01.560866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f639ba17-432d-4acb-9ecd-0eee39848d71 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:01.562119 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f639ba17-432d-4acb-9ecd-0eee39848d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:01.607244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:01.631503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 89/183] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:01.632704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a696-8f2d-4723-acdf-46681b0a971c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.632993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a696-8f2d-4723-acdf-46681b0a971c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.633321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a696-8f2d-4723-acdf-46681b0a971c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.637174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 90/184] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:01.637174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7a696-8f2d-4723-acdf-46681b0a971c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:01.639836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 95/185] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:01.640687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639ba17-432d-4acb-9ecd-0eee39848d71 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:01.668092 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:01.779886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639ba17-432d-4acb-9ecd-0eee39848d71 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:01.796187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7a696-8f2d-4723-acdf-46681b0a971c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:01.819432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a284f21-9f81-4bf1-9fae-3e39400f4655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:01.820064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a284f21-9f81-4bf1-9fae-3e39400f4655 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.820352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a284f21-9f81-4bf1-9fae-3e39400f4655 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.820632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a284f21-9f81-4bf1-9fae-3e39400f4655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.821462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a284f21-9f81-4bf1-9fae-3e39400f4655 None admin] RBAC: Adding query filter params (role.id=8458ab7384a043d2a03698163d3892fd, scope.project.id=484fa78f220f44fe81173d4a750ff138, user.id=94827b7fc9d34f2680ea4bbd23e01217) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:01.821772 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a284f21-9f81-4bf1-9fae-3e39400f4655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:01.823258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a284f21-9f81-4bf1-9fae-3e39400f4655 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:01.829283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 96/186] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:01 2022] GET /identity/v3/role_assignments?user.id=94827b7fc9d34f2680ea4bbd23e01217&scope.project.id=484fa78f220f44fe81173d4a750ff138&role.id=8458ab7384a043d2a03698163d3892fd => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:01.832169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e0647-0e07-4357-bf36-8cc1e96273eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:01.833491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e0647-0e07-4357-bf36-8cc1e96273eb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.833971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e0647-0e07-4357-bf36-8cc1e96273eb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.834415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a284f21-9f81-4bf1-9fae-3e39400f4655 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:01.834515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e0647-0e07-4357-bf36-8cc1e96273eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.835254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e0647-0e07-4357-bf36-8cc1e96273eb None admin] RBAC: Adding query filter params (role.id=0cb8656b530647bea1bc161edf344c96, scope.project.id=048254d114684a7e8e71048df03aaf23, user.id=94827b7fc9d34f2680ea4bbd23e01217) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:01.835565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e0647-0e07-4357-bf36-8cc1e96273eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:01.837065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e0647-0e07-4357-bf36-8cc1e96273eb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:01.844523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 91/187] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:01 2022] GET /identity/v3/role_assignments?user.id=94827b7fc9d34f2680ea4bbd23e01217&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=0cb8656b530647bea1bc161edf344c96 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:01.846019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22086361-78f1-4ff6-8e4c-03470dc971b4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:01.846305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22086361-78f1-4ff6-8e4c-03470dc971b4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:01.846577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22086361-78f1-4ff6-8e4c-03470dc971b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:01.884719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-22086361-78f1-4ff6-8e4c-03470dc971b4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:01.887400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-22086361-78f1-4ff6-8e4c-03470dc971b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:01.905653 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:02.006390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 92/188] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:02.007370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22086361-78f1-4ff6-8e4c-03470dc971b4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:02.008712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a284f21-9f81-4bf1-9fae-3e39400f4655 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.033718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:02.048930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867fd96-2480-4538-83bf-2ce715b707b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:02.049649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867fd96-2480-4538-83bf-2ce715b707b0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:02.049930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867fd96-2480-4538-83bf-2ce715b707b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:02.055101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867fd96-2480-4538-83bf-2ce715b707b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:02.067848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867fd96-2480-4538-83bf-2ce715b707b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a867fd96-2480-4538-83bf-2ce715b707b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:02.073985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:02.075056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 97/189] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:02.076057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867fd96-2480-4538-83bf-2ce715b707b0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:02.185844 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22086361-78f1-4ff6-8e4c-03470dc971b4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.211811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:02.215725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867fd96-2480-4538-83bf-2ce715b707b0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.220906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb48ec8-6819-45bf-a0cc-7f06b2948894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:02.221594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb48ec8-6819-45bf-a0cc-7f06b2948894 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:02.221888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb48ec8-6819-45bf-a0cc-7f06b2948894 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:02.222162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb48ec8-6819-45bf-a0cc-7f06b2948894 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:02.234228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb48ec8-6819-45bf-a0cc-7f06b2948894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-8cb48ec8-6819-45bf-a0cc-7f06b2948894 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:02.239235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:02.240293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:02.241063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 93/190] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:44:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:02.241766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb48ec8-6819-45bf-a0cc-7f06b2948894 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:02.263992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2204949-9ce0-4f66-9fbb-50c6295253d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:02.264641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2204949-9ce0-4f66-9fbb-50c6295253d3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:02.264921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2204949-9ce0-4f66-9fbb-50c6295253d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:02.265229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2204949-9ce0-4f66-9fbb-50c6295253d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:02.276201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2204949-9ce0-4f66-9fbb-50c6295253d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a2204949-9ce0-4f66-9fbb-50c6295253d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:02.281346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:02.282755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 98/191] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:02.283520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2204949-9ce0-4f66-9fbb-50c6295253d3 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:02.313999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:02.349501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb48ec8-6819-45bf-a0cc-7f06b2948894 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.385180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d7d78-4897-4f85-9d7c-f75b064865fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:02.385824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d7d78-4897-4f85-9d7c-f75b064865fa None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:02.386107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d7d78-4897-4f85-9d7c-f75b064865fa None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:02.386382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d7d78-4897-4f85-9d7c-f75b064865fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:02.387555 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d7d78-4897-4f85-9d7c-f75b064865fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:02.387658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2204949-9ce0-4f66-9fbb-50c6295253d3 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.389052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d7d78-4897-4f85-9d7c-f75b064865fa None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:02.390719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 94/192] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:02.391491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d7d78-4897-4f85-9d7c-f75b064865fa None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:02.425812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ac6f-9f67-46dd-807c-ab5ba6de3c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:02.427086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ac6f-9f67-46dd-807c-ab5ba6de3c0c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:02.427631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ac6f-9f67-46dd-807c-ab5ba6de3c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:02.427904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ac6f-9f67-46dd-807c-ab5ba6de3c0c None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:02.428713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776ac6f-9f67-46dd-807c-ab5ba6de3c0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:02.429012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776ac6f-9f67-46dd-807c-ab5ba6de3c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:02.430480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776ac6f-9f67-46dd-807c-ab5ba6de3c0c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:02.438644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 99/193] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:02.439470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ac6f-9f67-46dd-807c-ab5ba6de3c0c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:02.463977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:02.503978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d7d78-4897-4f85-9d7c-f75b064865fa None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.548998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6dfb4-d092-462f-9cf5-0c5ef1fb2b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:02.549655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6dfb4-d092-462f-9cf5-0c5ef1fb2b68 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:02.549934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6dfb4-d092-462f-9cf5-0c5ef1fb2b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:02.550212 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6dfb4-d092-462f-9cf5-0c5ef1fb2b68 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:02.550940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6dfb4-d092-462f-9cf5-0c5ef1fb2b68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:02.551249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6dfb4-d092-462f-9cf5-0c5ef1fb2b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:02.553055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6dfb4-d092-462f-9cf5-0c5ef1fb2b68 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:02.554715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:02.561132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ac6f-9f67-46dd-807c-ab5ba6de3c0c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.563520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 95/194] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:02.564599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6dfb4-d092-462f-9cf5-0c5ef1fb2b68 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:02.602448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c53ef-ff41-486d-ba96-6e9565547310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:02.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c53ef-ff41-486d-ba96-6e9565547310 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:02.603362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c53ef-ff41-486d-ba96-6e9565547310 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:02.603637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c53ef-ff41-486d-ba96-6e9565547310 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:02.604364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c53ef-ff41-486d-ba96-6e9565547310 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:02.604665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c53ef-ff41-486d-ba96-6e9565547310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:02.606323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c53ef-ff41-486d-ba96-6e9565547310 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:02.615302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 100/195] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:02.616162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c53ef-ff41-486d-ba96-6e9565547310 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:02.685204 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6dfb4-d092-462f-9cf5-0c5ef1fb2b68 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.713281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:02.720545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a1b3c-e2d0-4b47-9ed4-63f83cf56500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:02.728138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a1b3c-e2d0-4b47-9ed4-63f83cf56500 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:02.728138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a1b3c-e2d0-4b47-9ed4-63f83cf56500 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:02.728138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a1b3c-e2d0-4b47-9ed4-63f83cf56500 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:02.728138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a1b3c-e2d0-4b47-9ed4-63f83cf56500 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:02.728138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a1b3c-e2d0-4b47-9ed4-63f83cf56500 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:02.733169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c53ef-ff41-486d-ba96-6e9565547310 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.768910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4de59a-e7c4-43bf-8ff8-4b8a3fd9afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:02.769590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de59a-e7c4-43bf-8ff8-4b8a3fd9afd0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:02.769873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de59a-e7c4-43bf-8ff8-4b8a3fd9afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:02.770712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de59a-e7c4-43bf-8ff8-4b8a3fd9afd0 None admin] PATH_INFO: `/v3/users/12886352705442b6934085f431ce300a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:02.785264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4de59a-e7c4-43bf-8ff8-4b8a3fd9afd0 None admin] RBAC: Authorizing `identity:get_user(user_id=12886352705442b6934085f431ce300a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:02.787717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4de59a-e7c4-43bf-8ff8-4b8a3fd9afd0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:02.789510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 101/196] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:02 2022] GET /identity/v3/users/12886352705442b6934085f431ce300a => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:02.790380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4de59a-e7c4-43bf-8ff8-4b8a3fd9afd0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:02.822563 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 96/197] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:44:02 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:44:02.823512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a1b3c-e2d0-4b47-9ed4-63f83cf56500 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:02.910845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:02.938909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4de59a-e7c4-43bf-8ff8-4b8a3fd9afd0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.988577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a1b3c-e2d0-4b47-9ed4-63f83cf56500 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:02.990632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b08c5-8146-460a-8e76-f3c81962b88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:02.991600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b08c5-8146-460a-8e76-f3c81962b88c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:02.992036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b08c5-8146-460a-8e76-f3c81962b88c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:02.992409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b08c5-8146-460a-8e76-f3c81962b88c None admin] PATH_INFO: `/v3/users/12886352705442b6934085f431ce300a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:02.994420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b08c5-8146-460a-8e76-f3c81962b88c None admin] RBAC: Authorizing `identity:get_user(user_id=12886352705442b6934085f431ce300a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:02.996944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b08c5-8146-460a-8e76-f3c81962b88c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:02.999984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 102/198] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:02 2022] GET /identity/v3/users/12886352705442b6934085f431ce300a => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:03.001103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b08c5-8146-460a-8e76-f3c81962b88c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:03.020244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:03.049391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d20056-b302-4e1f-881a-372996aace7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:03.050080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d20056-b302-4e1f-881a-372996aace7c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:03.050360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d20056-b302-4e1f-881a-372996aace7c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:03.050639 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d20056-b302-4e1f-881a-372996aace7c None admin] PATH_INFO: `/v3/users/ce9b42c2f09d4cf8b9797037bdcd3665` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:03.053921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d20056-b302-4e1f-881a-372996aace7c None admin] RBAC: Authorizing `identity:get_user(user_id=ce9b42c2f09d4cf8b9797037bdcd3665)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:03.055364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d20056-b302-4e1f-881a-372996aace7c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:03.058034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 97/199] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:02 2022] GET /identity/v3/users/ce9b42c2f09d4cf8b9797037bdcd3665 => generated 289 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:03.058034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d20056-b302-4e1f-881a-372996aace7c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:03.197078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b08c5-8146-460a-8e76-f3c81962b88c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:03.250941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e048c1-2ab5-41d8-85d5-6abc1048ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:03.251687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d20056-b302-4e1f-881a-372996aace7c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:03.252151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e048c1-2ab5-41d8-85d5-6abc1048ce4e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:03.252649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e048c1-2ab5-41d8-85d5-6abc1048ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:03.253406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e048c1-2ab5-41d8-85d5-6abc1048ce4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:03.297533 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:03.309053 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264e60d-71f7-46ad-baf3-2edd233a6a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:03.310150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264e60d-71f7-46ad-baf3-2edd233a6a06 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:03.310641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264e60d-71f7-46ad-baf3-2edd233a6a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:03.311117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264e60d-71f7-46ad-baf3-2edd233a6a06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:03.357188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e048c1-2ab5-41d8-85d5-6abc1048ce4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:03.359402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e048c1-2ab5-41d8-85d5-6abc1048ce4e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:03.373024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:03.420852 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264e60d-71f7-46ad-baf3-2edd233a6a06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:03.423694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264e60d-71f7-46ad-baf3-2edd233a6a06 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:03.477818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 103/200] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:03.479017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e048c1-2ab5-41d8-85d5-6abc1048ce4e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:03.557807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 98/201] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:03.557807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264e60d-71f7-46ad-baf3-2edd233a6a06 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:03.590949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:03.604799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e048c1-2ab5-41d8-85d5-6abc1048ce4e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:03.617180 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:03.648539 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24815111-4ae9-4012-94a2-17852299d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:03.649847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815111-4ae9-4012-94a2-17852299d72d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:03.650391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815111-4ae9-4012-94a2-17852299d72d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:03.650912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815111-4ae9-4012-94a2-17852299d72d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:03.736630 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264e60d-71f7-46ad-baf3-2edd233a6a06 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:03.745744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24815111-4ae9-4012-94a2-17852299d72d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:03.747772 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24815111-4ae9-4012-94a2-17852299d72d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:03.789160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3548036-ebfc-4419-96d9-1c80c0c44ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:03.790199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3548036-ebfc-4419-96d9-1c80c0c44ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:03.790693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3548036-ebfc-4419-96d9-1c80c0c44ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:03.791167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3548036-ebfc-4419-96d9-1c80c0c44ad0 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:03.792593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3548036-ebfc-4419-96d9-1c80c0c44ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:03.794318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3548036-ebfc-4419-96d9-1c80c0c44ad0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:03.796225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 99/202] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:03 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:03.797267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3548036-ebfc-4419-96d9-1c80c0c44ad0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:03.902236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 104/203] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:03.903102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24815111-4ae9-4012-94a2-17852299d72d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:03.914670 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:03.921981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:03.935765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3548036-ebfc-4419-96d9-1c80c0c44ad0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:03.971762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9151e98-ad62-4d0e-ba82-64628552c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:03.972762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9151e98-ad62-4d0e-ba82-64628552c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:03.973793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9151e98-ad62-4d0e-ba82-64628552c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:03.974521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9151e98-ad62-4d0e-ba82-64628552c5d6 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:03.976048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9151e98-ad62-4d0e-ba82-64628552c5d6 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:03.977755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9151e98-ad62-4d0e-ba82-64628552c5d6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:03.984497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 100/204] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:03 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:03.985654 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9151e98-ad62-4d0e-ba82-64628552c5d6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:04.017166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24815111-4ae9-4012-94a2-17852299d72d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:04.055725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751223ac-ca27-4fd6-b1d5-ba422c76db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:04.056364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751223ac-ca27-4fd6-b1d5-ba422c76db75 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:04.056647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751223ac-ca27-4fd6-b1d5-ba422c76db75 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:04.056924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751223ac-ca27-4fd6-b1d5-ba422c76db75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:04.057863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751223ac-ca27-4fd6-b1d5-ba422c76db75 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=5c21175d79504afbab1ea1c1297c36f6, user.id=12886352705442b6934085f431ce300a) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:04.058181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751223ac-ca27-4fd6-b1d5-ba422c76db75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:04.059836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751223ac-ca27-4fd6-b1d5-ba422c76db75 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:04.065850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 105/205] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:03 2022] GET /identity/v3/role_assignments?user.id=12886352705442b6934085f431ce300a&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:04.074208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751223ac-ca27-4fd6-b1d5-ba422c76db75 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:04.104533 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9151e98-ad62-4d0e-ba82-64628552c5d6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:04.175147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb2c9-683a-4c86-9e64-795d4995337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:04.179160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb2c9-683a-4c86-9e64-795d4995337b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:04.179715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb2c9-683a-4c86-9e64-795d4995337b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:04.180213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb2c9-683a-4c86-9e64-795d4995337b None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:04.182831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdb2c9-683a-4c86-9e64-795d4995337b None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:04.185760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdb2c9-683a-4c86-9e64-795d4995337b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:04.189835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 101/206] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:03 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:04.198205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb2c9-683a-4c86-9e64-795d4995337b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:04.237242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:04.244695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:04.299698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751223ac-ca27-4fd6-b1d5-ba422c76db75 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:04.344093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f1744-9c9d-4e3d-8088-1b65210aed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:04.344733 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f1744-9c9d-4e3d-8088-1b65210aed86 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:04.345405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f1744-9c9d-4e3d-8088-1b65210aed86 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:04.345685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f1744-9c9d-4e3d-8088-1b65210aed86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:04.346497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f1744-9c9d-4e3d-8088-1b65210aed86 None admin] RBAC: Adding query filter params (role.id=0cb8656b530647bea1bc161edf344c96, scope.project.id=5c21175d79504afbab1ea1c1297c36f6, user.id=12886352705442b6934085f431ce300a) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:04.346805 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f1744-9c9d-4e3d-8088-1b65210aed86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:04.348388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f1744-9c9d-4e3d-8088-1b65210aed86 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:04.354166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb2c9-683a-4c86-9e64-795d4995337b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:04.356195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 106/207] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:04 2022] GET /identity/v3/role_assignments?user.id=12886352705442b6934085f431ce300a&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=0cb8656b530647bea1bc161edf344c96 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:04.407116 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9f399-d791-446b-b9a8-d119eb309487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:04.407773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f399-d791-446b-b9a8-d119eb309487 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:04.408059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f399-d791-446b-b9a8-d119eb309487 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:04.408341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f399-d791-446b-b9a8-d119eb309487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:04.409180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9f399-d791-446b-b9a8-d119eb309487 None admin] RBAC: Adding query filter params (role.id=dd692b78a44b4d12a6e16b7e98674be3, scope.project.id=048254d114684a7e8e71048df03aaf23, user.id=ce9b42c2f09d4cf8b9797037bdcd3665) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:04.409501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9f399-d791-446b-b9a8-d119eb309487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:04.411067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9f399-d791-446b-b9a8-d119eb309487 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:04.418587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 102/208] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:04 2022] GET /identity/v3/role_assignments?user.id=ce9b42c2f09d4cf8b9797037bdcd3665&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=dd692b78a44b4d12a6e16b7e98674be3 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:05.252915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6fa5c-59fa-4a13-b6d5-15656eab62a3 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:05.253442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6fa5c-59fa-4a13-b6d5-15656eab62a3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:05.253442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6fa5c-59fa-4a13-b6d5-15656eab62a3 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:05.255106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 107/209] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:05.260916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2df10-7595-448d-9740-a7d488f3eb82 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:05.261450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2df10-7595-448d-9740-a7d488f3eb82 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:05.261526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2df10-7595-448d-9740-a7d488f3eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:05.288550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-74c2df10-7595-448d-9740-a7d488f3eb82 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:05.290035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-74c2df10-7595-448d-9740-a7d488f3eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:05.355491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea094c26-3268-4367-8138-3ed5a8051943 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:05.355834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea094c26-3268-4367-8138-3ed5a8051943 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:05.356064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea094c26-3268-4367-8138-3ed5a8051943 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:05.358881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 108/210] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:05.363360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921b346-360a-4802-a785-0ec7a1d5eaa7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:05.363645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921b346-360a-4802-a785-0ec7a1d5eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:05.364476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921b346-360a-4802-a785-0ec7a1d5eaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:05.382827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 103/211] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:05.389142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2921b346-360a-4802-a785-0ec7a1d5eaa7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:05.389142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2921b346-360a-4802-a785-0ec7a1d5eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:05.413533 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2df10-7595-448d-9740-a7d488f3eb82 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:05.438546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:05.480052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 109/212] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:05.503846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921b346-360a-4802-a785-0ec7a1d5eaa7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:05.538278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2df10-7595-448d-9740-a7d488f3eb82 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:05.580282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411011c-1952-4baa-b02d-ddb059d79671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:05.581508 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411011c-1952-4baa-b02d-ddb059d79671 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:05.582009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411011c-1952-4baa-b02d-ddb059d79671 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:05.582589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411011c-1952-4baa-b02d-ddb059d79671 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:05.596212 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411011c-1952-4baa-b02d-ddb059d79671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-6411011c-1952-4baa-b02d-ddb059d79671 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:05.602179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:05.603080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:05.603857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:05.606608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 104/213] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:05.607375 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:05.616643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411011c-1952-4baa-b02d-ddb059d79671 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:05.665156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921b346-360a-4802-a785-0ec7a1d5eaa7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:05.711544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:05.712999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bad99-32bf-4105-aafa-38c1e07c2d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:05.713688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bad99-32bf-4105-aafa-38c1e07c2d0c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:05.713966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bad99-32bf-4105-aafa-38c1e07c2d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:05.714506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bad99-32bf-4105-aafa-38c1e07c2d0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:05.715680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bad99-32bf-4105-aafa-38c1e07c2d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:05.717337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bad99-32bf-4105-aafa-38c1e07c2d0c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:05.721203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 110/214] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:05.726715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bad99-32bf-4105-aafa-38c1e07c2d0c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:05.743663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411011c-1952-4baa-b02d-ddb059d79671 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:05.783118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb12706-35cb-4a7c-a9d5-f372ac1147e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:05.783836 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb12706-35cb-4a7c-a9d5-f372ac1147e7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:05.784211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb12706-35cb-4a7c-a9d5-f372ac1147e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:05.784581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb12706-35cb-4a7c-a9d5-f372ac1147e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:05.785543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb12706-35cb-4a7c-a9d5-f372ac1147e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:05.786583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb12706-35cb-4a7c-a9d5-f372ac1147e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:05.788215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb12706-35cb-4a7c-a9d5-f372ac1147e7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:05.804618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 105/215] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:05.807748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb12706-35cb-4a7c-a9d5-f372ac1147e7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:05.867104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bad99-32bf-4105-aafa-38c1e07c2d0c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:05.915279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25883-6b8b-4392-85f5-2a97ea49311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:05.916194 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25883-6b8b-4392-85f5-2a97ea49311e None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:05.916890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25883-6b8b-4392-85f5-2a97ea49311e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:05.917419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25883-6b8b-4392-85f5-2a97ea49311e None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:05.918676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e25883-6b8b-4392-85f5-2a97ea49311e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:05.920323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e25883-6b8b-4392-85f5-2a97ea49311e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:05.932803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:05.939664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb12706-35cb-4a7c-a9d5-f372ac1147e7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:05.981942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4f86-5162-4d2e-9bd3-bb6627d38f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:05.982607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4f86-5162-4d2e-9bd3-bb6627d38f2c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:05.982886 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4f86-5162-4d2e-9bd3-bb6627d38f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:05.983220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4f86-5162-4d2e-9bd3-bb6627d38f2c None admin] PATH_INFO: `/v3/users/44bd2fe625194a0aabe152038e1d0819` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:05.996964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:06.002866 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4f86-5162-4d2e-9bd3-bb6627d38f2c None admin] RBAC: Authorizing `identity:get_user(user_id=44bd2fe625194a0aabe152038e1d0819)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:06.004376 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4f86-5162-4d2e-9bd3-bb6627d38f2c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:06.008288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 106/216] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:05 2022] GET /identity/v3/users/44bd2fe625194a0aabe152038e1d0819 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:06.013701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4f86-5162-4d2e-9bd3-bb6627d38f2c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:06.049719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 111/217] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:44:05 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:44:06.153538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4f86-5162-4d2e-9bd3-bb6627d38f2c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:06.195060 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6cdf4-1d54-4f85-bbea-2a0fbcb4684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:06.195751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cdf4-1d54-4f85-bbea-2a0fbcb4684f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:06.196040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cdf4-1d54-4f85-bbea-2a0fbcb4684f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:06.196316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cdf4-1d54-4f85-bbea-2a0fbcb4684f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:06.275976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:06.279282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6cdf4-1d54-4f85-bbea-2a0fbcb4684f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:06.280804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6cdf4-1d54-4f85-bbea-2a0fbcb4684f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:06.396664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 107/218] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:44:06.402923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25883-6b8b-4392-85f5-2a97ea49311e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:06.416306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bde04-7f0a-46a0-b85b-5063ff395918 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:06.416606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bde04-7f0a-46a0-b85b-5063ff395918 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:06.416875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bde04-7f0a-46a0-b85b-5063ff395918 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:06.418592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 108/219] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:06.424156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bf50-d83f-49c1-87e9-9ef6e1c05a65 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:06.424446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bf50-d83f-49c1-87e9-9ef6e1c05a65 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:06.424887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bf50-d83f-49c1-87e9-9ef6e1c05a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:06.451619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0399bf50-d83f-49c1-87e9-9ef6e1c05a65 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:06.452842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0399bf50-d83f-49c1-87e9-9ef6e1c05a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:06.542604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25883-6b8b-4392-85f5-2a97ea49311e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:06.545053 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 109/220] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:06.546651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f1477-bbf0-4e73-8e2d-6aef7e4ef1f7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:06.546942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f1477-bbf0-4e73-8e2d-6aef7e4ef1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:06.547221 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f1477-bbf0-4e73-8e2d-6aef7e4ef1f7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:06.548803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 110/221] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:06.555778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0c0a-340c-4436-9b7d-d6de69f1aa79 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:06.555778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0c0a-340c-4436-9b7d-d6de69f1aa79 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:06.555778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0c0a-340c-4436-9b7d-d6de69f1aa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:06.575099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a0fb0c0a-340c-4436-9b7d-d6de69f1aa79 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:06.576303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0fb0c0a-340c-4436-9b7d-d6de69f1aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:06.591685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fac6e-9ac2-432a-b814-0a455f06b0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:06.592855 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fac6e-9ac2-432a-b814-0a455f06b0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:06.593794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fac6e-9ac2-432a-b814-0a455f06b0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:06.594233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fac6e-9ac2-432a-b814-0a455f06b0b2 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:06.596243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fac6e-9ac2-432a-b814-0a455f06b0b2 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:06.599025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fac6e-9ac2-432a-b814-0a455f06b0b2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:06.601758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 112/222] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:06 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:06.606325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fac6e-9ac2-432a-b814-0a455f06b0b2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:06.608787 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:06.673834 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 111/223] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:06.675080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0c0a-340c-4436-9b7d-d6de69f1aa79 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:06.681580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:06.739433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fac6e-9ac2-432a-b814-0a455f06b0b2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:06.779118 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fb6fb-1a2d-42a5-97f0-4c9c8b42e66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:06.779899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fb6fb-1a2d-42a5-97f0-4c9c8b42e66e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:06.780188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fb6fb-1a2d-42a5-97f0-4c9c8b42e66e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:06.780466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fb6fb-1a2d-42a5-97f0-4c9c8b42e66e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:06.788033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0c0a-340c-4436-9b7d-d6de69f1aa79 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:06.794297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fb6fb-1a2d-42a5-97f0-4c9c8b42e66e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-1d1fb6fb-1a2d-42a5-97f0-4c9c8b42e66e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:06.800769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:06.802414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:06.803204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 113/224] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:06.803842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fb6fb-1a2d-42a5-97f0-4c9c8b42e66e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:06.831487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecea85d-389e-43a9-912b-e4b3c5dca055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:06.833281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecea85d-389e-43a9-912b-e4b3c5dca055 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:06.833925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecea85d-389e-43a9-912b-e4b3c5dca055 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:06.834421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecea85d-389e-43a9-912b-e4b3c5dca055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:06.835429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecea85d-389e-43a9-912b-e4b3c5dca055 None admin] RBAC: Adding query filter params (role.id=8458ab7384a043d2a03698163d3892fd, scope.project.id=5c21175d79504afbab1ea1c1297c36f6, user.id=44bd2fe625194a0aabe152038e1d0819) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:06.835947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecea85d-389e-43a9-912b-e4b3c5dca055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:06.837737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecea85d-389e-43a9-912b-e4b3c5dca055 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:06.853621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 112/225] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:06 2022] GET /identity/v3/role_assignments?user.id=44bd2fe625194a0aabe152038e1d0819&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=8458ab7384a043d2a03698163d3892fd => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:06.855075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecea85d-389e-43a9-912b-e4b3c5dca055 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:06.897419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:06.925395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fb6fb-1a2d-42a5-97f0-4c9c8b42e66e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:06.970130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146f85a-c207-42ec-b9df-0dcec5dcdb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:06.971447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:06.972609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146f85a-c207-42ec-b9df-0dcec5dcdb75 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:06.973163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146f85a-c207-42ec-b9df-0dcec5dcdb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:06.974292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146f85a-c207-42ec-b9df-0dcec5dcdb75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:06.988156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146f85a-c207-42ec-b9df-0dcec5dcdb75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5146f85a-c207-42ec-b9df-0dcec5dcdb75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:06.997013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:06.997957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:06.998718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:07.008753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 114/226] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:44:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:07.010484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146f85a-c207-42ec-b9df-0dcec5dcdb75 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:07.096273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecea85d-389e-43a9-912b-e4b3c5dca055 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:07.148047 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146f85a-c207-42ec-b9df-0dcec5dcdb75 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:07.181365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d94a7-1dea-438e-8807-1dd35ad6e9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:07.182537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d94a7-1dea-438e-8807-1dd35ad6e9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:07.183040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d94a7-1dea-438e-8807-1dd35ad6e9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:07.183721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d94a7-1dea-438e-8807-1dd35ad6e9e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:07.185237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d94a7-1dea-438e-8807-1dd35ad6e9e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:07.185818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d94a7-1dea-438e-8807-1dd35ad6e9e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:07.188146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d94a7-1dea-438e-8807-1dd35ad6e9e3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:07.196952 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667926c9-3b7c-4589-82c6-27b8c40f8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:07.197595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667926c9-3b7c-4589-82c6-27b8c40f8571 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:07.197951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667926c9-3b7c-4589-82c6-27b8c40f8571 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:07.198291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667926c9-3b7c-4589-82c6-27b8c40f8571 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:07.199107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667926c9-3b7c-4589-82c6-27b8c40f8571 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:07.199454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667926c9-3b7c-4589-82c6-27b8c40f8571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:07.201712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 113/227] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:07.202816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667926c9-3b7c-4589-82c6-27b8c40f8571 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:07.210210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d94a7-1dea-438e-8807-1dd35ad6e9e3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:07.213654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 115/228] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:07.225416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667926c9-3b7c-4589-82c6-27b8c40f8571 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:07.295953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:07.319304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:07.337432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d94a7-1dea-438e-8807-1dd35ad6e9e3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:07.372973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe32764-7702-4246-a6bc-c859a1aa0b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:07.374016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe32764-7702-4246-a6bc-c859a1aa0b0d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:07.374593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe32764-7702-4246-a6bc-c859a1aa0b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:07.375061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe32764-7702-4246-a6bc-c859a1aa0b0d None admin] PATH_INFO: `/v3/users/12886352705442b6934085f431ce300a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:07.376438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe32764-7702-4246-a6bc-c859a1aa0b0d None admin] RBAC: Authorizing `identity:get_user(user_id=12886352705442b6934085f431ce300a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:07.378127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe32764-7702-4246-a6bc-c859a1aa0b0d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:07.381073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 114/229] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:07 2022] GET /identity/v3/users/12886352705442b6934085f431ce300a => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:07.388258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe32764-7702-4246-a6bc-c859a1aa0b0d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:07.418088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667926c9-3b7c-4589-82c6-27b8c40f8571 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:07.474424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b12db-d902-4770-ae17-97a86ef76c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:07.475010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b12db-d902-4770-ae17-97a86ef76c4d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:07.475293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b12db-d902-4770-ae17-97a86ef76c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:07.475808 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b12db-d902-4770-ae17-97a86ef76c4d None admin] PATH_INFO: `/v3/users/12886352705442b6934085f431ce300a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:07.477926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b12db-d902-4770-ae17-97a86ef76c4d None admin] RBAC: Authorizing `identity:get_user(user_id=12886352705442b6934085f431ce300a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:07.479433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b12db-d902-4770-ae17-97a86ef76c4d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:07.481221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 116/230] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:07 2022] GET /identity/v3/users/12886352705442b6934085f431ce300a => generated 283 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:07.488865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b12db-d902-4770-ae17-97a86ef76c4d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:07.559541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe32764-7702-4246-a6bc-c859a1aa0b0d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:07.620331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb4359-8d3e-4e63-b891-bfd5c03ba179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:07.620980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb4359-8d3e-4e63-b891-bfd5c03ba179 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:07.622644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb4359-8d3e-4e63-b891-bfd5c03ba179 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:07.622929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb4359-8d3e-4e63-b891-bfd5c03ba179 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:07.624873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb4359-8d3e-4e63-b891-bfd5c03ba179 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:07.626348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb4359-8d3e-4e63-b891-bfd5c03ba179 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:07.633461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 115/231] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:07 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:07.634776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb4359-8d3e-4e63-b891-bfd5c03ba179 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:07.675897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:07.682750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b12db-d902-4770-ae17-97a86ef76c4d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:07.696215 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:07.749672 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e4483-0a65-4724-b146-c2189caeee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:07.751318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4483-0a65-4724-b146-c2189caeee12 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:07.752356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4483-0a65-4724-b146-c2189caeee12 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:07.752980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4483-0a65-4724-b146-c2189caeee12 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:07.757522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e4483-0a65-4724-b146-c2189caeee12 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:07.759183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e4483-0a65-4724-b146-c2189caeee12 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:07.761082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 117/232] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:07 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:07.768655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e4483-0a65-4724-b146-c2189caeee12 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:07.829866 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb4359-8d3e-4e63-b891-bfd5c03ba179 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:07.902864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd501a0-7033-440a-b3a6-6fd1fea350cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:07.903547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd501a0-7033-440a-b3a6-6fd1fea350cb None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:07.903829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd501a0-7033-440a-b3a6-6fd1fea350cb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:07.904103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd501a0-7033-440a-b3a6-6fd1fea350cb None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6/users/12886352705442b6934085f431ce300a/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:07.911402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e4483-0a65-4724-b146-c2189caeee12 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:07.913902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd501a0-7033-440a-b3a6-6fd1fea350cb None admin] RBAC: Authorizing `identity:create_grant(project_id=5c21175d79504afbab1ea1c1297c36f6, user_id=12886352705442b6934085f431ce300a, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:07.915380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd501a0-7033-440a-b3a6-6fd1fea350cb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:07.956437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ec3a0-9ebb-44a3-8ec5-cae4ce1d80e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:07.957146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec3a0-9ebb-44a3-8ec5-cae4ce1d80e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:07.957422 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec3a0-9ebb-44a3-8ec5-cae4ce1d80e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:07.958247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec3a0-9ebb-44a3-8ec5-cae4ce1d80e6 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6/users/12886352705442b6934085f431ce300a/roles/0cb8656b530647bea1bc161edf344c96` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:07.960626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ec3a0-9ebb-44a3-8ec5-cae4ce1d80e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c21175d79504afbab1ea1c1297c36f6, user_id=12886352705442b6934085f431ce300a, role_id=0cb8656b530647bea1bc161edf344c96)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:07.962101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ec3a0-9ebb-44a3-8ec5-cae4ce1d80e6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:08.007528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 116/233] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:44:07 2022] PUT /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6/users/12886352705442b6934085f431ce300a/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:08.029935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 118/234] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:44:07 2022] PUT /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6/users/12886352705442b6934085f431ce300a/roles/0cb8656b530647bea1bc161edf344c96 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:08.543562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c14734-71c9-45a5-a3c4-475dfdcafc8a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:08.544667 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c14734-71c9-45a5-a3c4-475dfdcafc8a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:08.545212 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c14734-71c9-45a5-a3c4-475dfdcafc8a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:08.546846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 117/235] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:08.553385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3644e1-952b-48bd-8fe3-7b55f08b9459 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:08.554285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3644e1-952b-48bd-8fe3-7b55f08b9459 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:08.554764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3644e1-952b-48bd-8fe3-7b55f08b9459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:08.580868 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ed3644e1-952b-48bd-8fe3-7b55f08b9459 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:08.582608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ed3644e1-952b-48bd-8fe3-7b55f08b9459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:08.627662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:08.680031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 119/236] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:08.706715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6768-ae32-4202-8736-c443a6e7c3db None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:08.706903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6768-ae32-4202-8736-c443a6e7c3db None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:08.707138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6768-ae32-4202-8736-c443a6e7c3db None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:08.708283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3644e1-952b-48bd-8fe3-7b55f08b9459 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:08.709430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 118/237] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:08.715020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df919f4-fe0a-42fe-821b-6234d1b681f6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:08.715287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df919f4-fe0a-42fe-821b-6234d1b681f6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:08.715533 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df919f4-fe0a-42fe-821b-6234d1b681f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:08.735383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3df919f4-fe0a-42fe-821b-6234d1b681f6 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:08.736608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3df919f4-fe0a-42fe-821b-6234d1b681f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:08.844240 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 119/238] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:08.890740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3644e1-952b-48bd-8fe3-7b55f08b9459 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:08.909239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df919f4-fe0a-42fe-821b-6234d1b681f6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:08.938039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:08.951448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9884a-5555-41bc-83c4-cae78264ad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:08.952112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9884a-5555-41bc-83c4-cae78264ad49 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:08.952395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9884a-5555-41bc-83c4-cae78264ad49 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:08.952735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9884a-5555-41bc-83c4-cae78264ad49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:08.978988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9884a-5555-41bc-83c4-cae78264ad49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ace9884a-5555-41bc-83c4-cae78264ad49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:08.984072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:08.984928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:08.985740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:08.989294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 120/239] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:09.005649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9884a-5555-41bc-83c4-cae78264ad49 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:09.054952 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:09.080512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df919f4-fe0a-42fe-821b-6234d1b681f6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:09.151761 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4db518-3a33-4b16-8a94-5530f13b278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:09.152856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4db518-3a33-4b16-8a94-5530f13b278a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:09.153365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4db518-3a33-4b16-8a94-5530f13b278a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:09.153850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4db518-3a33-4b16-8a94-5530f13b278a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:09.155246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4db518-3a33-4b16-8a94-5530f13b278a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:09.156924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4db518-3a33-4b16-8a94-5530f13b278a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:09.159786 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 120/240] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:09.168484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4db518-3a33-4b16-8a94-5530f13b278a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:09.285503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9884a-5555-41bc-83c4-cae78264ad49 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:09.329493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:09.369825 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df8bee-32fc-4ecc-8924-2770969a1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:09.370391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4db518-3a33-4b16-8a94-5530f13b278a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:09.371282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df8bee-32fc-4ecc-8924-2770969a1885 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:09.371877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df8bee-32fc-4ecc-8924-2770969a1885 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:09.372339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df8bee-32fc-4ecc-8924-2770969a1885 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:09.373423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df8bee-32fc-4ecc-8924-2770969a1885 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:09.373929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df8bee-32fc-4ecc-8924-2770969a1885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:09.375528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df8bee-32fc-4ecc-8924-2770969a1885 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:09.388255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 121/241] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:09.390202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15788cb-292a-4c74-a891-330b6afff170 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:09.390723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15788cb-292a-4c74-a891-330b6afff170 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:09.391240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15788cb-292a-4c74-a891-330b6afff170 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:09.397073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 122/242] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:09.398455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15788cb-292a-4c74-a891-330b6afff170 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:09.411143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13447d-f430-4b90-a29d-c3440950257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:09.411670 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13447d-f430-4b90-a29d-c3440950257c None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:09.411960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13447d-f430-4b90-a29d-c3440950257c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:09.412266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13447d-f430-4b90-a29d-c3440950257c None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:09.413588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13447d-f430-4b90-a29d-c3440950257c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:09.415062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13447d-f430-4b90-a29d-c3440950257c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:09.517039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 121/243] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:44:09 2022] POST /identity/v3/users => generated 293 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:44:09.518680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d4e5c-3d71-4079-9c47-ba2af6c9ec28 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:09.519428 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d4e5c-3d71-4079-9c47-ba2af6c9ec28 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:09.519928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d4e5c-3d71-4079-9c47-ba2af6c9ec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:09.532713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:09.541883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-682d4e5c-3d71-4079-9c47-ba2af6c9ec28 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:09.543549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-682d4e5c-3d71-4079-9c47-ba2af6c9ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:09.563376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15788cb-292a-4c74-a891-330b6afff170 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:09.626190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141734-d777-4036-bd1d-f48db75bc031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:09.626852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141734-d777-4036-bd1d-f48db75bc031 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:09.627136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141734-d777-4036-bd1d-f48db75bc031 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:09.627485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141734-d777-4036-bd1d-f48db75bc031 None admin] PATH_INFO: `/v3/users/fd097c7f8d3441b59106f8d0d6a2a7e4` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:09.646163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 122/244] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:09.681060 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31141734-d777-4036-bd1d-f48db75bc031 None admin] RBAC: Authorizing `identity:get_user(user_id=fd097c7f8d3441b59106f8d0d6a2a7e4)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:09.682971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31141734-d777-4036-bd1d-f48db75bc031 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:09.685100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 123/245] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:09 2022] GET /identity/v3/users/fd097c7f8d3441b59106f8d0d6a2a7e4 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:09.687836 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d4e5c-3d71-4079-9c47-ba2af6c9ec28 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:09.698244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141734-d777-4036-bd1d-f48db75bc031 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:09.825505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:09.864573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141734-d777-4036-bd1d-f48db75bc031 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:09.875018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d4e5c-3d71-4079-9c47-ba2af6c9ec28 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:09.920108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ed3ee-c183-4fa6-a3ad-5d910fa9698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:09.921135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ed3ee-c183-4fa6-a3ad-5d910fa9698b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:09.921668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ed3ee-c183-4fa6-a3ad-5d910fa9698b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:09.922148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ed3ee-c183-4fa6-a3ad-5d910fa9698b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:09.926560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af64016-2ed6-4626-86e4-95e57a8ce516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:09.927792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af64016-2ed6-4626-86e4-95e57a8ce516 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:09.928252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af64016-2ed6-4626-86e4-95e57a8ce516 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:09.928723 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af64016-2ed6-4626-86e4-95e57a8ce516 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:09.943208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af64016-2ed6-4626-86e4-95e57a8ce516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-0af64016-2ed6-4626-86e4-95e57a8ce516 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:09.950942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:09.951892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:09.952682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 123/246] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:09.958537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af64016-2ed6-4626-86e4-95e57a8ce516 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:09.961811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:10.049617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ed3ee-c183-4fa6-a3ad-5d910fa9698b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:10.054052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ed3ee-c183-4fa6-a3ad-5d910fa9698b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:10.124540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af64016-2ed6-4626-86e4-95e57a8ce516 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:10.153383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:10.166987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d068337-5e5e-48d2-ac37-d13d6d4d06a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:10.167617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d068337-5e5e-48d2-ac37-d13d6d4d06a3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:10.167895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d068337-5e5e-48d2-ac37-d13d6d4d06a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:10.168168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d068337-5e5e-48d2-ac37-d13d6d4d06a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:10.168910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d068337-5e5e-48d2-ac37-d13d6d4d06a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:10.169250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d068337-5e5e-48d2-ac37-d13d6d4d06a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:10.170664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d068337-5e5e-48d2-ac37-d13d6d4d06a3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:10.173818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 124/247] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:10.180325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ed3ee-c183-4fa6-a3ad-5d910fa9698b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:10.181599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 124/248] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:10.187791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d068337-5e5e-48d2-ac37-d13d6d4d06a3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:10.234081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:10.303936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ed3ee-c183-4fa6-a3ad-5d910fa9698b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:10.308232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d068337-5e5e-48d2-ac37-d13d6d4d06a3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:10.349774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b803484-c2ee-4342-abe6-a493e56b8547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:10.350440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b803484-c2ee-4342-abe6-a493e56b8547 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:10.350720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b803484-c2ee-4342-abe6-a493e56b8547 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:10.351356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b803484-c2ee-4342-abe6-a493e56b8547 None admin] PATH_INFO: `/v3/users/44bd2fe625194a0aabe152038e1d0819` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:10.352605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b803484-c2ee-4342-abe6-a493e56b8547 None admin] RBAC: Authorizing `identity:get_user(user_id=44bd2fe625194a0aabe152038e1d0819)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:10.354131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b803484-c2ee-4342-abe6-a493e56b8547 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:10.355871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 125/249] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:10 2022] GET /identity/v3/users/44bd2fe625194a0aabe152038e1d0819 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:10.361395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b803484-c2ee-4342-abe6-a493e56b8547 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:10.371511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09767-b7fc-46fa-8671-13c7d886dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:10.372188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09767-b7fc-46fa-8671-13c7d886dfcb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:10.372460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09767-b7fc-46fa-8671-13c7d886dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:10.372727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09767-b7fc-46fa-8671-13c7d886dfcb None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:10.377962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab09767-b7fc-46fa-8671-13c7d886dfcb None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:10.380118 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab09767-b7fc-46fa-8671-13c7d886dfcb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:10.382651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 125/250] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:10 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:10.388310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09767-b7fc-46fa-8671-13c7d886dfcb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:10.425022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:10.479809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b803484-c2ee-4342-abe6-a493e56b8547 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:10.520518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990f44c-cae4-4903-80fd-4b64dfbab4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:10.521423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990f44c-cae4-4903-80fd-4b64dfbab4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:10.521861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990f44c-cae4-4903-80fd-4b64dfbab4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:10.522302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990f44c-cae4-4903-80fd-4b64dfbab4d5 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:10.523676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990f44c-cae4-4903-80fd-4b64dfbab4d5 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:10.525447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990f44c-cae4-4903-80fd-4b64dfbab4d5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:10.527627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 126/251] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:10 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:10.533512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990f44c-cae4-4903-80fd-4b64dfbab4d5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:10.617036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09767-b7fc-46fa-8671-13c7d886dfcb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:10.638179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:10.671653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990f44c-cae4-4903-80fd-4b64dfbab4d5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:10.678998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52df232-49a6-4031-bb21-11611dc7ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:10.679640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df232-49a6-4031-bb21-11611dc7ccee None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:10.679920 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df232-49a6-4031-bb21-11611dc7ccee None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:10.680192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df232-49a6-4031-bb21-11611dc7ccee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:10.680993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52df232-49a6-4031-bb21-11611dc7ccee None admin] RBAC: Adding query filter params (role.id=dd692b78a44b4d12a6e16b7e98674be3, scope.project.id=5c21175d79504afbab1ea1c1297c36f6, user.id=fd097c7f8d3441b59106f8d0d6a2a7e4) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:10.681333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52df232-49a6-4031-bb21-11611dc7ccee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:10.682789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52df232-49a6-4031-bb21-11611dc7ccee None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:10.688684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 126/252] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:10 2022] GET /identity/v3/role_assignments?user.id=fd097c7f8d3441b59106f8d0d6a2a7e4&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=dd692b78a44b4d12a6e16b7e98674be3 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:10.700089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b284f07-4280-48aa-8647-5a54e08f625a None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:10.700367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b284f07-4280-48aa-8647-5a54e08f625a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:10.700647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b284f07-4280-48aa-8647-5a54e08f625a None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:10.701352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:10.702227 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 127/253] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:10.708397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f276-6830-479e-b92c-2440c0a99537 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:10.708811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f276-6830-479e-b92c-2440c0a99537 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:10.709259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f276-6830-479e-b92c-2440c0a99537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:10.716305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f0f42-39e9-44fd-ae5c-2e1901f20b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:10.717216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f0f42-39e9-44fd-ae5c-2e1901f20b05 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:10.717641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f0f42-39e9-44fd-ae5c-2e1901f20b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:10.718168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f0f42-39e9-44fd-ae5c-2e1901f20b05 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6/users/44bd2fe625194a0aabe152038e1d0819/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:10.720401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f0f42-39e9-44fd-ae5c-2e1901f20b05 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c21175d79504afbab1ea1c1297c36f6, user_id=44bd2fe625194a0aabe152038e1d0819, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:10.722139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f0f42-39e9-44fd-ae5c-2e1901f20b05 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:10.742138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-81f4f276-6830-479e-b92c-2440c0a99537 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:10.743363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-81f4f276-6830-479e-b92c-2440c0a99537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:10.807848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 127/254] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:44:10 2022] PUT /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6/users/44bd2fe625194a0aabe152038e1d0819/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:44:10.837222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae015a6-0474-450d-aeb6-992fe656ba4f None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:10.837543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae015a6-0474-450d-aeb6-992fe656ba4f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:10.837787 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae015a6-0474-450d-aeb6-992fe656ba4f None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:10.839535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 128/255] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:10.850846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06825-af84-4923-a49e-a5ff02e458f0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:10.851156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06825-af84-4923-a49e-a5ff02e458f0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:10.851419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06825-af84-4923-a49e-a5ff02e458f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:10.853984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 128/256] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:10.881964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f276-6830-479e-b92c-2440c0a99537 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:10.892006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-14e06825-af84-4923-a49e-a5ff02e458f0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:10.893303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-14e06825-af84-4923-a49e-a5ff02e458f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:11.008302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f276-6830-479e-b92c-2440c0a99537 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:11.018688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:11.047171 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 129/257] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:11.066096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e042b-62bb-40e5-a568-50abb1f3f16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:11.067120 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e042b-62bb-40e5-a568-50abb1f3f16d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:11.067828 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e042b-62bb-40e5-a568-50abb1f3f16d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:11.068263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e042b-62bb-40e5-a568-50abb1f3f16d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:11.083108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e06825-af84-4923-a49e-a5ff02e458f0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:11.085767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e042b-62bb-40e5-a568-50abb1f3f16d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b98e042b-62bb-40e5-a568-50abb1f3f16d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:11.091131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:11.093294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:11.094261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:11.095316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 129/258] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:11.101423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e042b-62bb-40e5-a568-50abb1f3f16d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:11.286673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e042b-62bb-40e5-a568-50abb1f3f16d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:11.290207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e06825-af84-4923-a49e-a5ff02e458f0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:11.315759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:11.371517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c5543-e0d3-4a7e-90a9-511ff05971bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:11.372157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c5543-e0d3-4a7e-90a9-511ff05971bd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:11.372442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c5543-e0d3-4a7e-90a9-511ff05971bd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:11.372724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c5543-e0d3-4a7e-90a9-511ff05971bd None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:11.373494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c5543-e0d3-4a7e-90a9-511ff05971bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:11.373801 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c5543-e0d3-4a7e-90a9-511ff05971bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:11.375210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c5543-e0d3-4a7e-90a9-511ff05971bd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:11.377369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378327c5-9a64-4891-a1d0-a744f3ec4b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:11.378037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378327c5-9a64-4891-a1d0-a744f3ec4b46 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:11.378316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378327c5-9a64-4891-a1d0-a744f3ec4b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:11.378590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378327c5-9a64-4891-a1d0-a744f3ec4b46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:11.403577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378327c5-9a64-4891-a1d0-a744f3ec4b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:11.405253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 130/259] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:11.407685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c5543-e0d3-4a7e-90a9-511ff05971bd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-378327c5-9a64-4891-a1d0-a744f3ec4b46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:11.411515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:11.412727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:11.413539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 130/260] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:44:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:11.428763 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378327c5-9a64-4891-a1d0-a744f3ec4b46 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:11.502191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:11.682049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378327c5-9a64-4891-a1d0-a744f3ec4b46 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:11.687777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c5543-e0d3-4a7e-90a9-511ff05971bd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:11.774081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd432d66-7d34-46c2-bf5b-6cb47b2b0b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:11.774731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd432d66-7d34-46c2-bf5b-6cb47b2b0b2b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:11.775302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd432d66-7d34-46c2-bf5b-6cb47b2b0b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:11.775585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd432d66-7d34-46c2-bf5b-6cb47b2b0b2b None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:11.776319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd432d66-7d34-46c2-bf5b-6cb47b2b0b2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:11.776626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd432d66-7d34-46c2-bf5b-6cb47b2b0b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:11.778608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd432d66-7d34-46c2-bf5b-6cb47b2b0b2b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:11.789018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 131/261] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:11.795944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd432d66-7d34-46c2-bf5b-6cb47b2b0b2b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:11.810072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7771a-1c47-4327-b722-b44982ecf64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:11.810767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7771a-1c47-4327-b722-b44982ecf64b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:11.811053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7771a-1c47-4327-b722-b44982ecf64b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:11.811329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7771a-1c47-4327-b722-b44982ecf64b None admin] PATH_INFO: `/v3/users/12886352705442b6934085f431ce300a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:11.812723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7771a-1c47-4327-b722-b44982ecf64b None admin] RBAC: Authorizing `identity:get_user(user_id=12886352705442b6934085f431ce300a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:11.814387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7771a-1c47-4327-b722-b44982ecf64b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:11.816496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 131/262] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:11 2022] GET /identity/v3/users/12886352705442b6934085f431ce300a => generated 283 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:11.822815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7771a-1c47-4327-b722-b44982ecf64b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:11.873497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:12.021704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:12.027018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7771a-1c47-4327-b722-b44982ecf64b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:12.076128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd432d66-7d34-46c2-bf5b-6cb47b2b0b2b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:12.111629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff1d6b-866f-4fec-ad3e-588e37e645d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:12.112330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1d6b-866f-4fec-ad3e-588e37e645d3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:12.112616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1d6b-866f-4fec-ad3e-588e37e645d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:12.112895 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1d6b-866f-4fec-ad3e-588e37e645d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:12.174535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cecbd-4586-46a3-a758-1b6c34928a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:12.175205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cecbd-4586-46a3-a758-1b6c34928a0b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:12.175488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cecbd-4586-46a3-a758-1b6c34928a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:12.175760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cecbd-4586-46a3-a758-1b6c34928a0b None admin] PATH_INFO: `/v3/users/12886352705442b6934085f431ce300a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:12.178126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cecbd-4586-46a3-a758-1b6c34928a0b None admin] RBAC: Authorizing `identity:get_user(user_id=12886352705442b6934085f431ce300a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:12.179750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cecbd-4586-46a3-a758-1b6c34928a0b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:12.185216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 132/263] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:11 2022] GET /identity/v3/users/12886352705442b6934085f431ce300a => generated 283 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:12.187394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cecbd-4586-46a3-a758-1b6c34928a0b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:12.297179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff1d6b-866f-4fec-ad3e-588e37e645d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:12.298629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff1d6b-866f-4fec-ad3e-588e37e645d3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:12.427998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cecbd-4586-46a3-a758-1b6c34928a0b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:12.437161 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:12.443203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:12.448966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 132/264] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:44:12.456238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff1d6b-866f-4fec-ad3e-588e37e645d3 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:12.570009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fffa1-ae56-4a9d-8fb5-c05ca437a8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:12.570560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fffa1-ae56-4a9d-8fb5-c05ca437a8bc None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:12.570849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fffa1-ae56-4a9d-8fb5-c05ca437a8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:12.571125 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fffa1-ae56-4a9d-8fb5-c05ca437a8bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:12.588077 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff1d6b-866f-4fec-ad3e-588e37e645d3 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:12.638782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2215e-4841-4685-88e9-3f613ee34226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:12.639454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2215e-4841-4685-88e9-3f613ee34226 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:12.639734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2215e-4841-4685-88e9-3f613ee34226 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:12.640008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2215e-4841-4685-88e9-3f613ee34226 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:12.641240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2215e-4841-4685-88e9-3f613ee34226 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:12.642799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2215e-4841-4685-88e9-3f613ee34226 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:12.649226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 133/265] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:12 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:12.664971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2215e-4841-4685-88e9-3f613ee34226 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:12.694434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fffa1-ae56-4a9d-8fb5-c05ca437a8bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:12.695955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fffa1-ae56-4a9d-8fb5-c05ca437a8bc None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:12.806346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 133/266] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:44:12.811811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fffa1-ae56-4a9d-8fb5-c05ca437a8bc None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:12.813849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:12.837336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:12.919200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2215e-4841-4685-88e9-3f613ee34226 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:12.927856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fffa1-ae56-4a9d-8fb5-c05ca437a8bc None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:12.989140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048132b-711c-416c-ae79-c80f402b1541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:12.990253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048132b-711c-416c-ae79-c80f402b1541 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:12.990614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048132b-711c-416c-ae79-c80f402b1541 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:12.990961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048132b-711c-416c-ae79-c80f402b1541 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:12.997144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048132b-711c-416c-ae79-c80f402b1541 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:12.997144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048132b-711c-416c-ae79-c80f402b1541 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:12.998468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 134/267] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:12 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:13.005147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048132b-711c-416c-ae79-c80f402b1541 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:13.069864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15960f53-a72d-4bc3-8c1e-151b461d3d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:13.070789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15960f53-a72d-4bc3-8c1e-151b461d3d39 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.071245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15960f53-a72d-4bc3-8c1e-151b461d3d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.071664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15960f53-a72d-4bc3-8c1e-151b461d3d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.072670 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15960f53-a72d-4bc3-8c1e-151b461d3d39 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=5c21175d79504afbab1ea1c1297c36f6, user.id=12886352705442b6934085f431ce300a) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:13.073235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15960f53-a72d-4bc3-8c1e-151b461d3d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:13.074904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15960f53-a72d-4bc3-8c1e-151b461d3d39 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:13.090875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 134/268] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:12 2022] GET /identity/v3/role_assignments?user.id=12886352705442b6934085f431ce300a&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 608 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:13.135753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bedb2c-07ee-4287-9e43-5c5c9c24ed6a None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.136273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bedb2c-07ee-4287-9e43-5c5c9c24ed6a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.136719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bedb2c-07ee-4287-9e43-5c5c9c24ed6a None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.138707 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 135/269] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:13.144182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:13.146540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f8dc-d76e-4f16-96a3-c5617041c394 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.147167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f8dc-d76e-4f16-96a3-c5617041c394 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.147645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f8dc-d76e-4f16-96a3-c5617041c394 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.149814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 136/270] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:13.155538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60402d-a89e-4403-b700-11e0dd2f5ddb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.156163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60402d-a89e-4403-b700-11e0dd2f5ddb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.156638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60402d-a89e-4403-b700-11e0dd2f5ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.202284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-eb60402d-a89e-4403-b700-11e0dd2f5ddb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:13.203543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-eb60402d-a89e-4403-b700-11e0dd2f5ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:13.235179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048132b-711c-416c-ae79-c80f402b1541 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:13.309461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b4900-4ac0-4014-87b5-8c96c7aff880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:13.310488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b4900-4ac0-4014-87b5-8c96c7aff880 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.310966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b4900-4ac0-4014-87b5-8c96c7aff880 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.311454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b4900-4ac0-4014-87b5-8c96c7aff880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.312495 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b4900-4ac0-4014-87b5-8c96c7aff880 None admin] RBAC: Adding query filter params (role.id=0cb8656b530647bea1bc161edf344c96, scope.project.id=5c21175d79504afbab1ea1c1297c36f6, user.id=12886352705442b6934085f431ce300a) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:13.313051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b4900-4ac0-4014-87b5-8c96c7aff880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:13.314767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b4900-4ac0-4014-87b5-8c96c7aff880 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:13.325287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 135/271] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:13 2022] GET /identity/v3/role_assignments?user.id=12886352705442b6934085f431ce300a&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=0cb8656b530647bea1bc161edf344c96 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:13.327099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63603385-0052-4170-9dee-ef2619d1cd2e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.327621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63603385-0052-4170-9dee-ef2619d1cd2e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.328225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63603385-0052-4170-9dee-ef2619d1cd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.359767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-63603385-0052-4170-9dee-ef2619d1cd2e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:13.361615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-63603385-0052-4170-9dee-ef2619d1cd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:13.379591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 137/272] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:13.437105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60402d-a89e-4403-b700-11e0dd2f5ddb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:13.486951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 136/273] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:13.527789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63603385-0052-4170-9dee-ef2619d1cd2e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:13.561284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:13.639691 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:13.642467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60402d-a89e-4403-b700-11e0dd2f5ddb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:13.694587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86375b6-ac6e-40f0-9fe8-7c1e3646ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:13.695815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86375b6-ac6e-40f0-9fe8-7c1e3646ef9f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.696342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86375b6-ac6e-40f0-9fe8-7c1e3646ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.696856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86375b6-ac6e-40f0-9fe8-7c1e3646ef9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.698456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86375b6-ac6e-40f0-9fe8-7c1e3646ef9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:13.699880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63603385-0052-4170-9dee-ef2619d1cd2e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:13.701011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86375b6-ac6e-40f0-9fe8-7c1e3646ef9f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:13.703297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 138/274] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:13.709987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86375b6-ac6e-40f0-9fe8-7c1e3646ef9f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:13.750284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d490f84-b02c-4530-b90a-f60928e9c5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:13.751096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d490f84-b02c-4530-b90a-f60928e9c5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.751727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d490f84-b02c-4530-b90a-f60928e9c5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.752080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d490f84-b02c-4530-b90a-f60928e9c5c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.765774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d490f84-b02c-4530-b90a-f60928e9c5c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1d490f84-b02c-4530-b90a-f60928e9c5c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:13.771237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:13.772254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:13.773028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 137/275] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:13.774138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4180a-5a9a-49f0-8a06-5f6c99c7e6f7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.774336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4180a-5a9a-49f0-8a06-5f6c99c7e6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.774614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4180a-5a9a-49f0-8a06-5f6c99c7e6f7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.776170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 138/276] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:13.779128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4180a-5a9a-49f0-8a06-5f6c99c7e6f7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:13.847524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86375b6-ac6e-40f0-9fe8-7c1e3646ef9f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:13.881464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:13.889063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc755a8e-80e7-46db-b14c-9fdc288b2ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:13.895285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc755a8e-80e7-46db-b14c-9fdc288b2ce3 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.895285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc755a8e-80e7-46db-b14c-9fdc288b2ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.895285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc755a8e-80e7-46db-b14c-9fdc288b2ce3 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.895285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc755a8e-80e7-46db-b14c-9fdc288b2ce3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:13.895285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc755a8e-80e7-46db-b14c-9fdc288b2ce3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:13.912766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4180a-5a9a-49f0-8a06-5f6c99c7e6f7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:13.938526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:13.948983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc72dc5-4d6f-4a22-a198-b70c74e66ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:13.949633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72dc5-4d6f-4a22-a198-b70c74e66ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.949916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72dc5-4d6f-4a22-a198-b70c74e66ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.950193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72dc5-4d6f-4a22-a198-b70c74e66ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.950939 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc72dc5-4d6f-4a22-a198-b70c74e66ec8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:13.951248 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc72dc5-4d6f-4a22-a198-b70c74e66ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:13.952684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc72dc5-4d6f-4a22-a198-b70c74e66ec8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:13.961784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 139/277] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:13.963010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8755c4-93fa-4272-8b69-82494a7e6848 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:13.963296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8755c4-93fa-4272-8b69-82494a7e6848 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:13.963575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8755c4-93fa-4272-8b69-82494a7e6848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:13.982111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8c8755c4-93fa-4272-8b69-82494a7e6848 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:13.983329 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8c8755c4-93fa-4272-8b69-82494a7e6848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:14.017150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 139/278] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:44:13 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:44:14.017150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540735d-6f8f-4a40-bc47-db2834a11cf8 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:14.017150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540735d-6f8f-4a40-bc47-db2834a11cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:14.017150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540735d-6f8f-4a40-bc47-db2834a11cf8 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:14.017150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 140/279] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:14.017150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540735d-6f8f-4a40-bc47-db2834a11cf8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:14.064826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 140/280] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:14.066370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d0d14-bf02-4553-9610-848a6d53aa17 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:14.066668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d0d14-bf02-4553-9610-848a6d53aa17 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:14.067055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d0d14-bf02-4553-9610-848a6d53aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:14.091117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3d1d0d14-bf02-4553-9610-848a6d53aa17 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:14.092480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3d1d0d14-bf02-4553-9610-848a6d53aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:14.165638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540735d-6f8f-4a40-bc47-db2834a11cf8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:14.170456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 141/281] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:14.171071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d0d14-bf02-4553-9610-848a6d53aa17 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:14.206364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6944f9f-6b60-46e7-ab09-0108f7f00e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:14.208148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6944f9f-6b60-46e7-ab09-0108f7f00e78 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:14.208148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6944f9f-6b60-46e7-ab09-0108f7f00e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:14.208344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6944f9f-6b60-46e7-ab09-0108f7f00e78 None admin] PATH_INFO: `/v3/users/3971bb4a2bf14a198609195f5c49bfa5` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:14.226137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6944f9f-6b60-46e7-ab09-0108f7f00e78 None admin] RBAC: Authorizing `identity:get_user(user_id=3971bb4a2bf14a198609195f5c49bfa5)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:14.227591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:14.227775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6944f9f-6b60-46e7-ab09-0108f7f00e78 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:14.229788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 141/282] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:14 2022] GET /identity/v3/users/3971bb4a2bf14a198609195f5c49bfa5 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:14.230435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6944f9f-6b60-46e7-ab09-0108f7f00e78 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:14.290448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:14.303944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d0d14-bf02-4553-9610-848a6d53aa17 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:14.352689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3798c7d-0303-4246-8f26-e983414efbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:14.353392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3798c7d-0303-4246-8f26-e983414efbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:14.353676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3798c7d-0303-4246-8f26-e983414efbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:14.353952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3798c7d-0303-4246-8f26-e983414efbb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:14.363432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6944f9f-6b60-46e7-ab09-0108f7f00e78 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:14.370421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3798c7d-0303-4246-8f26-e983414efbb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b3798c7d-0303-4246-8f26-e983414efbb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:14.375972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:14.376986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 142/283] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:14.378561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3798c7d-0303-4246-8f26-e983414efbb4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:14.419966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacdd7a-e8a7-4f2f-a911-d434e060b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:14.420587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacdd7a-e8a7-4f2f-a911-d434e060b41c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:14.420869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacdd7a-e8a7-4f2f-a911-d434e060b41c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:14.421224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacdd7a-e8a7-4f2f-a911-d434e060b41c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:14.437380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacdd7a-e8a7-4f2f-a911-d434e060b41c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2eacdd7a-e8a7-4f2f-a911-d434e060b41c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:14.445351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:14.447364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 142/284] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:14.449319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacdd7a-e8a7-4f2f-a911-d434e060b41c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:14.498413 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3798c7d-0303-4246-8f26-e983414efbb4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:14.507681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:14.543860 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e718b-2e83-4964-9c8a-20ff57b9a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:14.544531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e718b-2e83-4964-9c8a-20ff57b9a6bc None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:14.544809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e718b-2e83-4964-9c8a-20ff57b9a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:14.545083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e718b-2e83-4964-9c8a-20ff57b9a6bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:14.545956 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e718b-2e83-4964-9c8a-20ff57b9a6bc None admin] RBAC: Adding query filter params (role.id=8458ab7384a043d2a03698163d3892fd, user.id=3971bb4a2bf14a198609195f5c49bfa5, scope.system=all) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:14.546988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e718b-2e83-4964-9c8a-20ff57b9a6bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:14.548764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e718b-2e83-4964-9c8a-20ff57b9a6bc None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:14.559930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 143/285] 10.222.0.55 () {56 vars in 1308 bytes} [Mon Jul 25 22:44:14 2022] GET /identity/v3/role_assignments?user.id=3971bb4a2bf14a198609195f5c49bfa5&scope.system=all&role.id=8458ab7384a043d2a03698163d3892fd => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:14.561012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e718b-2e83-4964-9c8a-20ff57b9a6bc None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:14.623564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacdd7a-e8a7-4f2f-a911-d434e060b41c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:14.627862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:14.716934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb454f73-de4e-461b-89eb-8488935158a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:14.717530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb454f73-de4e-461b-89eb-8488935158a0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:14.717807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb454f73-de4e-461b-89eb-8488935158a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:14.718237 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb454f73-de4e-461b-89eb-8488935158a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:14.720386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb454f73-de4e-461b-89eb-8488935158a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:14.720386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb454f73-de4e-461b-89eb-8488935158a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:14.721044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb454f73-de4e-461b-89eb-8488935158a0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:14.734798 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e718b-2e83-4964-9c8a-20ff57b9a6bc None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:14.740097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 143/286] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:14.751801 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb454f73-de4e-461b-89eb-8488935158a0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:14.804076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8148f17-7c42-45f4-9179-64931c6b4e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:14.804627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8148f17-7c42-45f4-9179-64931c6b4e24 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:14.804915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8148f17-7c42-45f4-9179-64931c6b4e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:14.805236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8148f17-7c42-45f4-9179-64931c6b4e24 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:14.805977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8148f17-7c42-45f4-9179-64931c6b4e24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:14.806292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8148f17-7c42-45f4-9179-64931c6b4e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:14.807697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8148f17-7c42-45f4-9179-64931c6b4e24 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:14.818161 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 144/287] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:14.824152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8148f17-7c42-45f4-9179-64931c6b4e24 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:14.873699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:14.899787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb454f73-de4e-461b-89eb-8488935158a0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:14.934562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8148f17-7c42-45f4-9179-64931c6b4e24 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:14.971643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3a952-d4c9-4458-87f4-3585c585d45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:14.972212 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3a952-d4c9-4458-87f4-3585c585d45f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:14.972499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3a952-d4c9-4458-87f4-3585c585d45f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:14.972777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3a952-d4c9-4458-87f4-3585c585d45f None admin] PATH_INFO: `/v3/users/44bd2fe625194a0aabe152038e1d0819` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:14.974877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79871cd8-8b42-4d7f-87b6-d79602490656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:14.975006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3a952-d4c9-4458-87f4-3585c585d45f None admin] RBAC: Authorizing `identity:get_user(user_id=44bd2fe625194a0aabe152038e1d0819)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:14.975533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79871cd8-8b42-4d7f-87b6-d79602490656 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:14.975810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79871cd8-8b42-4d7f-87b6-d79602490656 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:14.976080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79871cd8-8b42-4d7f-87b6-d79602490656 None admin] PATH_INFO: `/v3/users/fd097c7f8d3441b59106f8d0d6a2a7e4` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:14.976396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3a952-d4c9-4458-87f4-3585c585d45f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:14.978210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 145/288] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:14 2022] GET /identity/v3/users/44bd2fe625194a0aabe152038e1d0819 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:14.979090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79871cd8-8b42-4d7f-87b6-d79602490656 None admin] RBAC: Authorizing `identity:get_user(user_id=fd097c7f8d3441b59106f8d0d6a2a7e4)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:14.980654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79871cd8-8b42-4d7f-87b6-d79602490656 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:14.982330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 144/289] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:14 2022] GET /identity/v3/users/fd097c7f8d3441b59106f8d0d6a2a7e4 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:14.983979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3a952-d4c9-4458-87f4-3585c585d45f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:14.987799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79871cd8-8b42-4d7f-87b6-d79602490656 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:15.053493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:15.143470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:15.146701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79871cd8-8b42-4d7f-87b6-d79602490656 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:15.148412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3a952-d4c9-4458-87f4-3585c585d45f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:15.187635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec1dfd-0534-45cc-a372-25190b3f7bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:15.188816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec1dfd-0534-45cc-a372-25190b3f7bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:15.189097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec1dfd-0534-45cc-a372-25190b3f7bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:15.189400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec1dfd-0534-45cc-a372-25190b3f7bb4 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:15.190629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec1dfd-0534-45cc-a372-25190b3f7bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:15.192917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec1dfd-0534-45cc-a372-25190b3f7bb4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:15.195750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 145/290] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:14 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:15.201095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec1dfd-0534-45cc-a372-25190b3f7bb4 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:15.213738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b06ec-f673-48ac-9660-6368e2ab0d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:15.214445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b06ec-f673-48ac-9660-6368e2ab0d90 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:15.214729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b06ec-f673-48ac-9660-6368e2ab0d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:15.215006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b06ec-f673-48ac-9660-6368e2ab0d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:15.289619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b06ec-f673-48ac-9660-6368e2ab0d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:15.291110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b06ec-f673-48ac-9660-6368e2ab0d90 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:15.386232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec1dfd-0534-45cc-a372-25190b3f7bb4 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:15.411907 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:15.416493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 146/291] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:15.420399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:15.424891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b06ec-f673-48ac-9660-6368e2ab0d90 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:15.443899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb5e43-ecaa-40e4-b5c8-49ca58b1ea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:15.444598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb5e43-ecaa-40e4-b5c8-49ca58b1ea15 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:15.444888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb5e43-ecaa-40e4-b5c8-49ca58b1ea15 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:15.445200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb5e43-ecaa-40e4-b5c8-49ca58b1ea15 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6/users/fd097c7f8d3441b59106f8d0d6a2a7e4/roles/dd692b78a44b4d12a6e16b7e98674be3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:15.449913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb5e43-ecaa-40e4-b5c8-49ca58b1ea15 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c21175d79504afbab1ea1c1297c36f6, user_id=fd097c7f8d3441b59106f8d0d6a2a7e4, role_id=dd692b78a44b4d12a6e16b7e98674be3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:15.451507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb5e43-ecaa-40e4-b5c8-49ca58b1ea15 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:15.527544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 146/292] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:44:15 2022] PUT /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6/users/fd097c7f8d3441b59106f8d0d6a2a7e4/roles/dd692b78a44b4d12a6e16b7e98674be3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:44:15.566256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b06ec-f673-48ac-9660-6368e2ab0d90 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:15.607346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4bb0-0681-4c2e-b6e3-562fe8370367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:15.608015 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4bb0-0681-4c2e-b6e3-562fe8370367 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:15.608301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4bb0-0681-4c2e-b6e3-562fe8370367 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:15.608692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4bb0-0681-4c2e-b6e3-562fe8370367 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:15.610120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4bb0-0681-4c2e-b6e3-562fe8370367 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:15.611912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4bb0-0681-4c2e-b6e3-562fe8370367 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:15.613844 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 147/293] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:15 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:15.622385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb5e43-ecaa-40e4-b5c8-49ca58b1ea15 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:15.775234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb5e43-ecaa-40e4-b5c8-49ca58b1ea15 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:15.823060 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc70b39-6d88-4e6f-829a-10cd311e27cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:15.823616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc70b39-6d88-4e6f-829a-10cd311e27cb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:15.823899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc70b39-6d88-4e6f-829a-10cd311e27cb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:15.824176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc70b39-6d88-4e6f-829a-10cd311e27cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:15.824980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc70b39-6d88-4e6f-829a-10cd311e27cb None admin] RBAC: Adding query filter params (role.id=8458ab7384a043d2a03698163d3892fd, scope.project.id=5c21175d79504afbab1ea1c1297c36f6, user.id=44bd2fe625194a0aabe152038e1d0819) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:15.825323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc70b39-6d88-4e6f-829a-10cd311e27cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:15.826932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc70b39-6d88-4e6f-829a-10cd311e27cb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:15.834336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 147/294] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:15 2022] GET /identity/v3/role_assignments?user.id=44bd2fe625194a0aabe152038e1d0819&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=8458ab7384a043d2a03698163d3892fd => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:16.481499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8d4a-e489-4931-8810-067c5f91625b None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:16.482008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8d4a-e489-4931-8810-067c5f91625b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:16.482081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8d4a-e489-4931-8810-067c5f91625b None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:16.483673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 148/295] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:16.489656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ec78a-ccda-4522-933c-25927cc47568 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:16.490110 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ec78a-ccda-4522-933c-25927cc47568 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:16.490318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ec78a-ccda-4522-933c-25927cc47568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:16.509907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ac4ec78a-ccda-4522-933c-25927cc47568 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:16.511118 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ac4ec78a-ccda-4522-933c-25927cc47568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:16.530579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:16.588227 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 148/296] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:16.631639 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e8d4a-e489-4931-8810-067c5f91625b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:16.756899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8e14-ff49-4913-a0a1-20e541a30b8d None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:16.757156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8e14-ff49-4913-a0a1-20e541a30b8d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:16.757515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8e14-ff49-4913-a0a1-20e541a30b8d None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:16.759232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 149/297] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:16.761775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:16.765826 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57219b2-7f1e-4487-9efc-bfc47c7dad55 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:16.766665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57219b2-7f1e-4487-9efc-bfc47c7dad55 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:16.767443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57219b2-7f1e-4487-9efc-bfc47c7dad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:16.799662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d57219b2-7f1e-4487-9efc-bfc47c7dad55 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:16.803352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d57219b2-7f1e-4487-9efc-bfc47c7dad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:16.803915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e8d4a-e489-4931-8810-067c5f91625b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:16.847134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0d94-7eee-4f9d-84f1-5955818e26df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:16.847789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0d94-7eee-4f9d-84f1-5955818e26df None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:16.848233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0d94-7eee-4f9d-84f1-5955818e26df None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:16.848559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0d94-7eee-4f9d-84f1-5955818e26df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:16.861487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a0d94-7eee-4f9d-84f1-5955818e26df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-c56a0d94-7eee-4f9d-84f1-5955818e26df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:16.867699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:16.877841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 149/298] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:16.879915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0d94-7eee-4f9d-84f1-5955818e26df None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:16.935712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 150/299] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:16.960958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57219b2-7f1e-4487-9efc-bfc47c7dad55 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:17.011217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0d94-7eee-4f9d-84f1-5955818e26df None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:17.045785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:17.055897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e490a6-3fbe-4368-9c65-4e40e917e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:17.056174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:17.056909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e490a6-3fbe-4368-9c65-4e40e917e610 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.057241 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e490a6-3fbe-4368-9c65-4e40e917e610 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.074814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e490a6-3fbe-4368-9c65-4e40e917e610 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.074814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e490a6-3fbe-4368-9c65-4e40e917e610 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:17.074814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e490a6-3fbe-4368-9c65-4e40e917e610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:17.074814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e490a6-3fbe-4368-9c65-4e40e917e610 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:17.074814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 150/300] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:17.076482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e490a6-3fbe-4368-9c65-4e40e917e610 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:17.080223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57219b2-7f1e-4487-9efc-bfc47c7dad55 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:17.125498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c597036-75da-4712-ae47-f03b8247034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:17.126182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c597036-75da-4712-ae47-f03b8247034e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.126459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c597036-75da-4712-ae47-f03b8247034e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.126729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c597036-75da-4712-ae47-f03b8247034e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.128007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c597036-75da-4712-ae47-f03b8247034e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:17.129778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c597036-75da-4712-ae47-f03b8247034e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:17.131605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 151/301] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:17.137026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c597036-75da-4712-ae47-f03b8247034e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:17.263459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e490a6-3fbe-4368-9c65-4e40e917e610 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:17.291315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c597036-75da-4712-ae47-f03b8247034e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:17.303162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ee0cd-8bc7-460b-89eb-7f7994c7382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:17.304149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ee0cd-8bc7-460b-89eb-7f7994c7382b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.304514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ee0cd-8bc7-460b-89eb-7f7994c7382b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.304858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ee0cd-8bc7-460b-89eb-7f7994c7382b None admin] PATH_INFO: `/v3/users/6f3ed525294d497fb461bd71da3e0524` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.322622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ee0cd-8bc7-460b-89eb-7f7994c7382b None admin] RBAC: Authorizing `identity:get_user(user_id=6f3ed525294d497fb461bd71da3e0524)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:17.324123 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ee0cd-8bc7-460b-89eb-7f7994c7382b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:17.326057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 151/302] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:17 2022] GET /identity/v3/users/6f3ed525294d497fb461bd71da3e0524 => generated 293 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:17.331561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102516b6-4e02-411c-bc81-3f8d35a37407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:17.331871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9d53-a78e-493a-af35-dc52f3771a21 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.332163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9d53-a78e-493a-af35-dc52f3771a21 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.332258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102516b6-4e02-411c-bc81-3f8d35a37407 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.332486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9d53-a78e-493a-af35-dc52f3771a21 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.332585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102516b6-4e02-411c-bc81-3f8d35a37407 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.332799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102516b6-4e02-411c-bc81-3f8d35a37407 None admin] PATH_INFO: `/v3/groups` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.333509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102516b6-4e02-411c-bc81-3f8d35a37407 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:17.334133 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 152/303] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:17.334698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd9d53-a78e-493a-af35-dc52f3771a21 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:17.339134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102516b6-4e02-411c-bc81-3f8d35a37407 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:17.387520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:17.413631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 152/304] 10.222.0.55 () {60 vars in 1134 bytes} [Mon Jul 25 22:44:17 2022] POST /identity/v3/groups => generated 229 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:44:17.415458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319618-59ee-4da9-a456-bc0afdcb389a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.415992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319618-59ee-4da9-a456-bc0afdcb389a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.416481 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319618-59ee-4da9-a456-bc0afdcb389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.440729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7e319618-59ee-4da9-a456-bc0afdcb389a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:17.443211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7e319618-59ee-4da9-a456-bc0afdcb389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:17.453158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:17.468742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd9d53-a78e-493a-af35-dc52f3771a21 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:17.524944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f5775-65e0-4993-8561-1027ee91c6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:17.525683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f5775-65e0-4993-8561-1027ee91c6af None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.526050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f5775-65e0-4993-8561-1027ee91c6af None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.527027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f5775-65e0-4993-8561-1027ee91c6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.528340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f5775-65e0-4993-8561-1027ee91c6af None admin] RBAC: Adding query filter params (role.id=dd692b78a44b4d12a6e16b7e98674be3, user.id=6f3ed525294d497fb461bd71da3e0524, scope.system=all) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:17.528760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f5775-65e0-4993-8561-1027ee91c6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:17.531426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f5775-65e0-4993-8561-1027ee91c6af None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:17.540880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 153/305] 10.222.0.55 () {56 vars in 1308 bytes} [Mon Jul 25 22:44:17 2022] GET /identity/v3/role_assignments?user.id=6f3ed525294d497fb461bd71da3e0524&scope.system=all&role.id=dd692b78a44b4d12a6e16b7e98674be3 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:17.549582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 153/306] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:17.575792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f5775-65e0-4993-8561-1027ee91c6af None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:17.706682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f5775-65e0-4993-8561-1027ee91c6af None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:17.723646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:17.749294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f880007-c7eb-452a-adb9-1b631dc71064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:17.749947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f880007-c7eb-452a-adb9-1b631dc71064 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.750223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f880007-c7eb-452a-adb9-1b631dc71064 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.750493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f880007-c7eb-452a-adb9-1b631dc71064 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.762530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f880007-c7eb-452a-adb9-1b631dc71064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-0f880007-c7eb-452a-adb9-1b631dc71064 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:17.767451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:17.768328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:17.769328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 154/307] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:17.777835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319618-59ee-4da9-a456-bc0afdcb389a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:17.889554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319618-59ee-4da9-a456-bc0afdcb389a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:17.933564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac89a6-68d8-4324-96e8-2a1e832527ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:17.934213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac89a6-68d8-4324-96e8-2a1e832527ce None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.934490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac89a6-68d8-4324-96e8-2a1e832527ce None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.934755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac89a6-68d8-4324-96e8-2a1e832527ce None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.935480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac89a6-68d8-4324-96e8-2a1e832527ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:17.935781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac89a6-68d8-4324-96e8-2a1e832527ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:17.937177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac89a6-68d8-4324-96e8-2a1e832527ce None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:17.951830 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 154/308] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:17.953241 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f880007-c7eb-452a-adb9-1b631dc71064 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:17.987242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29a6d6-cd91-472f-8639-bae3fcfeb193 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.987635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29a6d6-cd91-472f-8639-bae3fcfeb193 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.987911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29a6d6-cd91-472f-8639-bae3fcfeb193 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.990392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 155/309] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:17.996228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f26b7b-95cb-4ef8-81d9-eb9f489833b6 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.996735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f26b7b-95cb-4ef8-81d9-eb9f489833b6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.997244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f26b7b-95cb-4ef8-81d9-eb9f489833b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:18.006496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:18.018249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-26f26b7b-95cb-4ef8-81d9-eb9f489833b6 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:18.019797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-26f26b7b-95cb-4ef8-81d9-eb9f489833b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:18.081992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f880007-c7eb-452a-adb9-1b631dc71064 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:18.124600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f54a6-5cea-4c8e-a22e-d251a85d384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:18.125701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f54a6-5cea-4c8e-a22e-d251a85d384c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:18.126193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f54a6-5cea-4c8e-a22e-d251a85d384c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:18.126669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f54a6-5cea-4c8e-a22e-d251a85d384c None admin] PATH_INFO: `/v3/users/3971bb4a2bf14a198609195f5c49bfa5` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:18.128032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f54a6-5cea-4c8e-a22e-d251a85d384c None admin] RBAC: Authorizing `identity:get_user(user_id=3971bb4a2bf14a198609195f5c49bfa5)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:18.128454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 156/310] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:18.130128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f54a6-5cea-4c8e-a22e-d251a85d384c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:18.136568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 155/311] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:17 2022] GET /identity/v3/users/3971bb4a2bf14a198609195f5c49bfa5 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:18.137671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f26b7b-95cb-4ef8-81d9-eb9f489833b6 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:18.155425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f54a6-5cea-4c8e-a22e-d251a85d384c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:18.209442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:18.274655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f26b7b-95cb-4ef8-81d9-eb9f489833b6 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:18.286409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f54a6-5cea-4c8e-a22e-d251a85d384c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:18.325284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec093d-3033-4924-b751-cd57db1f8b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:18.326076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec093d-3033-4924-b751-cd57db1f8b54 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:18.326363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec093d-3033-4924-b751-cd57db1f8b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:18.326642 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec093d-3033-4924-b751-cd57db1f8b54 None admin] PATH_INFO: `/v3/system/users/3971bb4a2bf14a198609195f5c49bfa5/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:18.328391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec093d-3033-4924-b751-cd57db1f8b54 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3971bb4a2bf14a198609195f5c49bfa5, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:18.329178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820319f-e28a-4e2c-a540-189496a93b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:18.329820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec093d-3033-4924-b751-cd57db1f8b54 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:18.330033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820319f-e28a-4e2c-a540-189496a93b31 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:18.330408 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820319f-e28a-4e2c-a540-189496a93b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:18.330775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820319f-e28a-4e2c-a540-189496a93b31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:18.331521 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820319f-e28a-4e2c-a540-189496a93b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-6820319f-e28a-4e2c-a540-189496a93b31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:18.355681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:18.356523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:18.357531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 156/312] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:18.358870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820319f-e28a-4e2c-a540-189496a93b31 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:18.442186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 157/313] 10.222.0.55 () {58 vars in 1334 bytes} [Mon Jul 25 22:44:18 2022] PUT /identity/v3/system/users/3971bb4a2bf14a198609195f5c49bfa5/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:18.493893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:18.497645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820319f-e28a-4e2c-a540-189496a93b31 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:18.541283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd53f26-e2c7-426f-9575-f6712ca3d2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:18.542882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd53f26-e2c7-426f-9575-f6712ca3d2de None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:18.543371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd53f26-e2c7-426f-9575-f6712ca3d2de None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:18.543876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd53f26-e2c7-426f-9575-f6712ca3d2de None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:18.544874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd53f26-e2c7-426f-9575-f6712ca3d2de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:18.545484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd53f26-e2c7-426f-9575-f6712ca3d2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:18.547231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd53f26-e2c7-426f-9575-f6712ca3d2de None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:18.558349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 157/314] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:18.566564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec093d-3033-4924-b751-cd57db1f8b54 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:18.695255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec093d-3033-4924-b751-cd57db1f8b54 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:18.731652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632427d-605d-40d9-88ff-27679fc1880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:18.732334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632427d-605d-40d9-88ff-27679fc1880f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:18.732611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632427d-605d-40d9-88ff-27679fc1880f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:18.732889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632427d-605d-40d9-88ff-27679fc1880f None admin] PATH_INFO: `/v3/users/fd097c7f8d3441b59106f8d0d6a2a7e4` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:18.734294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632427d-605d-40d9-88ff-27679fc1880f None admin] RBAC: Authorizing `identity:get_user(user_id=fd097c7f8d3441b59106f8d0d6a2a7e4)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:18.735807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632427d-605d-40d9-88ff-27679fc1880f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:18.737812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 158/315] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:18 2022] GET /identity/v3/users/fd097c7f8d3441b59106f8d0d6a2a7e4 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:18.744440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd53f26-e2c7-426f-9575-f6712ca3d2de None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:18.856132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd53f26-e2c7-426f-9575-f6712ca3d2de None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:18.895614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d6940-d616-4bf8-8a4e-13af296c703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:18.896258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d6940-d616-4bf8-8a4e-13af296c703a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:18.896536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d6940-d616-4bf8-8a4e-13af296c703a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:18.896819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d6940-d616-4bf8-8a4e-13af296c703a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:18.929924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:18.968783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d6940-d616-4bf8-8a4e-13af296c703a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:18.970274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d6940-d616-4bf8-8a4e-13af296c703a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:19.086740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 158/316] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:19.090264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632427d-605d-40d9-88ff-27679fc1880f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:19.161262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:19.199749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632427d-605d-40d9-88ff-27679fc1880f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:19.240380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea896a5b-ba96-44d0-9864-cae1dbd637c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:19.240956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea896a5b-ba96-44d0-9864-cae1dbd637c8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:19.241282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea896a5b-ba96-44d0-9864-cae1dbd637c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:19.241560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea896a5b-ba96-44d0-9864-cae1dbd637c8 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:19.242756 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea896a5b-ba96-44d0-9864-cae1dbd637c8 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:19.244202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea896a5b-ba96-44d0-9864-cae1dbd637c8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:19.246238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 159/317] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:19 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:19.251941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d6940-d616-4bf8-8a4e-13af296c703a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:19.369518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:19.373811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d6940-d616-4bf8-8a4e-13af296c703a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:19.414943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df065f89-440d-471e-b0d4-1b05fe9ab78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:19.415639 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df065f89-440d-471e-b0d4-1b05fe9ab78e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:19.415925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df065f89-440d-471e-b0d4-1b05fe9ab78e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:19.416200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df065f89-440d-471e-b0d4-1b05fe9ab78e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:19.417012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df065f89-440d-471e-b0d4-1b05fe9ab78e None admin] RBAC: Adding query filter params (role.id=dd692b78a44b4d12a6e16b7e98674be3, scope.project.id=5c21175d79504afbab1ea1c1297c36f6, user.id=fd097c7f8d3441b59106f8d0d6a2a7e4) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:19.417350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df065f89-440d-471e-b0d4-1b05fe9ab78e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:19.418835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df065f89-440d-471e-b0d4-1b05fe9ab78e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:19.430109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 159/318] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:19 2022] GET /identity/v3/role_assignments?user.id=fd097c7f8d3441b59106f8d0d6a2a7e4&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=dd692b78a44b4d12a6e16b7e98674be3 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:19.710546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2068714-a596-4832-8a94-cf16ebbfe965 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:19.711085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2068714-a596-4832-8a94-cf16ebbfe965 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:19.711085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2068714-a596-4832-8a94-cf16ebbfe965 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:19.712455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 160/319] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:44:19.718010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc124611-ab45-4b72-b9ff-0d127aa14a29 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:19.718443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc124611-ab45-4b72-b9ff-0d127aa14a29 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:19.718625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc124611-ab45-4b72-b9ff-0d127aa14a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:19.738228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bc124611-ab45-4b72-b9ff-0d127aa14a29 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:19.739636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bc124611-ab45-4b72-b9ff-0d127aa14a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:19.756701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ccdb4-fdbd-4ee0-aa88-49a925cc77d7 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:19.757202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ccdb4-fdbd-4ee0-aa88-49a925cc77d7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:19.757657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ccdb4-fdbd-4ee0-aa88-49a925cc77d7 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:19.761177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 161/320] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:19.765887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30e3fe-0f4e-4325-9ee1-3b01875f01da None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:19.766171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30e3fe-0f4e-4325-9ee1-3b01875f01da None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:19.766447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30e3fe-0f4e-4325-9ee1-3b01875f01da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:19.785432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4b30e3fe-0f4e-4325-9ee1-3b01875f01da None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:19.787294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4b30e3fe-0f4e-4325-9ee1-3b01875f01da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:19.816507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 160/321] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:19.840124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc124611-ab45-4b72-b9ff-0d127aa14a29 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:19.870659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 162/322] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:19.893583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30e3fe-0f4e-4325-9ee1-3b01875f01da None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:19.907409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:19.954196 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc124611-ab45-4b72-b9ff-0d127aa14a29 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:19.964511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:19.989608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d321fe9-b2ec-43eb-ae5f-eb79eca39cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:19.990257 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d321fe9-b2ec-43eb-ae5f-eb79eca39cfb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:19.990537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d321fe9-b2ec-43eb-ae5f-eb79eca39cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:19.990809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d321fe9-b2ec-43eb-ae5f-eb79eca39cfb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:20.001402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d321fe9-b2ec-43eb-ae5f-eb79eca39cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:20.006409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30e3fe-0f4e-4325-9ee1-3b01875f01da None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-6d321fe9-b2ec-43eb-ae5f-eb79eca39cfb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:20.007025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:20.008002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:20.010084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 161/323] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:20.014089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d321fe9-b2ec-43eb-ae5f-eb79eca39cfb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:20.048300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d482e8-d01d-4ffd-b9cf-7c0795a1edab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:20.049380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d482e8-d01d-4ffd-b9cf-7c0795a1edab None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:20.049849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d482e8-d01d-4ffd-b9cf-7c0795a1edab None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:20.050296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d482e8-d01d-4ffd-b9cf-7c0795a1edab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:20.052467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d482e8-d01d-4ffd-b9cf-7c0795a1edab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:20.054134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d482e8-d01d-4ffd-b9cf-7c0795a1edab None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:20.056067 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 163/324] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:20.061736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d482e8-d01d-4ffd-b9cf-7c0795a1edab None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:20.125043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d321fe9-b2ec-43eb-ae5f-eb79eca39cfb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:20.145975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:20.166702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a76d2-20e2-4e4d-a76e-da1ae265f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:20.167334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a76d2-20e2-4e4d-a76e-da1ae265f02b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:20.167618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a76d2-20e2-4e4d-a76e-da1ae265f02b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:20.167892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a76d2-20e2-4e4d-a76e-da1ae265f02b None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:20.168672 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a76d2-20e2-4e4d-a76e-da1ae265f02b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:20.169020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a76d2-20e2-4e4d-a76e-da1ae265f02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:20.170454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a76d2-20e2-4e4d-a76e-da1ae265f02b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:20.176681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d482e8-d01d-4ffd-b9cf-7c0795a1edab None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:20.180122 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 162/325] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:20.185666 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a76d2-20e2-4e4d-a76e-da1ae265f02b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:20.215596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:20.220203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc3919-611a-4af1-a0f6-82e605cabd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:20.220836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc3919-611a-4af1-a0f6-82e605cabd20 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:20.221202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc3919-611a-4af1-a0f6-82e605cabd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:20.226075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc3919-611a-4af1-a0f6-82e605cabd20 None admin] PATH_INFO: `/v3/groups` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:20.226075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc3919-611a-4af1-a0f6-82e605cabd20 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:20.226075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc3919-611a-4af1-a0f6-82e605cabd20 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:20.293570 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a76d2-20e2-4e4d-a76e-da1ae265f02b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:20.327385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 164/326] 10.222.0.55 () {60 vars in 1134 bytes} [Mon Jul 25 22:44:20 2022] POST /identity/v3/groups => generated 226 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:44:20.330829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b972ff-6b9e-49c8-beaa-2a5b0cbfbf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:20.331527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b972ff-6b9e-49c8-beaa-2a5b0cbfbf0b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:20.331809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b972ff-6b9e-49c8-beaa-2a5b0cbfbf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:20.332091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b972ff-6b9e-49c8-beaa-2a5b0cbfbf0b None admin] PATH_INFO: `/v3/users/6f3ed525294d497fb461bd71da3e0524` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:20.334092 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b972ff-6b9e-49c8-beaa-2a5b0cbfbf0b None admin] RBAC: Authorizing `identity:get_user(user_id=6f3ed525294d497fb461bd71da3e0524)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:20.341561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b972ff-6b9e-49c8-beaa-2a5b0cbfbf0b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:20.341561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 163/327] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:20 2022] GET /identity/v3/users/6f3ed525294d497fb461bd71da3e0524 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:20.343401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc3919-611a-4af1-a0f6-82e605cabd20 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:20.460575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc3919-611a-4af1-a0f6-82e605cabd20 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:20.498062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ecf32-2f2e-4ec3-affc-c06dea9952a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:20.498667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ecf32-2f2e-4ec3-affc-c06dea9952a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:20.498950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ecf32-2f2e-4ec3-affc-c06dea9952a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:20.499230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ecf32-2f2e-4ec3-affc-c06dea9952a5 None admin] PATH_INFO: `/v3/system/users/6f3ed525294d497fb461bd71da3e0524/roles/dd692b78a44b4d12a6e16b7e98674be3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:20.500717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ecf32-2f2e-4ec3-affc-c06dea9952a5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6f3ed525294d497fb461bd71da3e0524, role_id=dd692b78a44b4d12a6e16b7e98674be3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:20.502141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ecf32-2f2e-4ec3-affc-c06dea9952a5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:20.561688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 165/328] 10.222.0.55 () {58 vars in 1334 bytes} [Mon Jul 25 22:44:20 2022] PUT /identity/v3/system/users/6f3ed525294d497fb461bd71da3e0524/roles/dd692b78a44b4d12a6e16b7e98674be3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:20.596576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c543f-56b5-4984-bc2a-1c690192cc7b None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:20.596896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c543f-56b5-4984-bc2a-1c690192cc7b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:20.597231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c543f-56b5-4984-bc2a-1c690192cc7b None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:20.598943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 164/329] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:20.608327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b9eb2-7852-4e82-9925-0ef1735a135b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:20.608327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b9eb2-7852-4e82-9925-0ef1735a135b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:20.608327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b9eb2-7852-4e82-9925-0ef1735a135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:20.627564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b37b9eb2-7852-4e82-9925-0ef1735a135b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:20.628849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b37b9eb2-7852-4e82-9925-0ef1735a135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:20.694329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:20.713809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 166/330] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:20.736549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c543f-56b5-4984-bc2a-1c690192cc7b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:20.800485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:20.871294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c543f-56b5-4984-bc2a-1c690192cc7b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:20.915147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80940cda-2262-4215-86a0-739694ec14ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:20.915862 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80940cda-2262-4215-86a0-739694ec14ca None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:20.916153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80940cda-2262-4215-86a0-739694ec14ca None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:20.916436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80940cda-2262-4215-86a0-739694ec14ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:20.932830 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80940cda-2262-4215-86a0-739694ec14ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-80940cda-2262-4215-86a0-739694ec14ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:20.938505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:20.939412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:20.940410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 165/331] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:20.945819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b9eb2-7852-4e82-9925-0ef1735a135b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:21.081555 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b9eb2-7852-4e82-9925-0ef1735a135b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:21.123147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635c487-914e-41c0-8703-cdbb89d7026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:21.123785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635c487-914e-41c0-8703-cdbb89d7026c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:21.124065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635c487-914e-41c0-8703-cdbb89d7026c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:21.124338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635c487-914e-41c0-8703-cdbb89d7026c None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:21.125062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635c487-914e-41c0-8703-cdbb89d7026c None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:21.125391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635c487-914e-41c0-8703-cdbb89d7026c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:21.126772 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635c487-914e-41c0-8703-cdbb89d7026c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:21.138696 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 167/332] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:21.144555 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80940cda-2262-4215-86a0-739694ec14ca None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:21.268706 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80940cda-2262-4215-86a0-739694ec14ca None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:21.281748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:21.317960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fbf6a-799c-4ddf-a5d2-7e08f7e4ae4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:21.318952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fbf6a-799c-4ddf-a5d2-7e08f7e4ae4a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:21.319431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fbf6a-799c-4ddf-a5d2-7e08f7e4ae4a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:21.319882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fbf6a-799c-4ddf-a5d2-7e08f7e4ae4a None admin] PATH_INFO: `/v3/users/3971bb4a2bf14a198609195f5c49bfa5` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:21.321357 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fbf6a-799c-4ddf-a5d2-7e08f7e4ae4a None admin] RBAC: Authorizing `identity:get_user(user_id=3971bb4a2bf14a198609195f5c49bfa5)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:21.323024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fbf6a-799c-4ddf-a5d2-7e08f7e4ae4a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:21.324907 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 166/333] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:21 2022] GET /identity/v3/users/3971bb4a2bf14a198609195f5c49bfa5 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:21.330932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635c487-914e-41c0-8703-cdbb89d7026c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:21.386248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:21.451418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635c487-914e-41c0-8703-cdbb89d7026c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:21.494067 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46721e-7fde-44cd-a77a-d9118b8144e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:21.495029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46721e-7fde-44cd-a77a-d9118b8144e9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:21.495529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46721e-7fde-44cd-a77a-d9118b8144e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:21.495980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46721e-7fde-44cd-a77a-d9118b8144e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:21.496988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46721e-7fde-44cd-a77a-d9118b8144e9 None admin] RBAC: Adding query filter params (role.id=8458ab7384a043d2a03698163d3892fd, user.id=3971bb4a2bf14a198609195f5c49bfa5, scope.system=all) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:21.497519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46721e-7fde-44cd-a77a-d9118b8144e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:21.499216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46721e-7fde-44cd-a77a-d9118b8144e9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:21.516757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 168/334] 10.222.0.55 () {56 vars in 1308 bytes} [Mon Jul 25 22:44:21 2022] GET /identity/v3/role_assignments?user.id=3971bb4a2bf14a198609195f5c49bfa5&scope.system=all&role.id=8458ab7384a043d2a03698163d3892fd => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:22.940220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a0bd-9322-4b54-ba24-29fa869503c7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:22.940725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a0bd-9322-4b54-ba24-29fa869503c7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:22.940821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a0bd-9322-4b54-ba24-29fa869503c7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:22.942496 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 167/335] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:22.947881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d8927-7df7-4576-95c4-04e1a07a12e2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:22.948355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d8927-7df7-4576-95c4-04e1a07a12e2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:22.948428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d8927-7df7-4576-95c4-04e1a07a12e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:22.970377 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f86d8927-7df7-4576-95c4-04e1a07a12e2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:22.971585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f86d8927-7df7-4576-95c4-04e1a07a12e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:23.030381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504bd08-3b85-40bd-b62b-f8314d6e7041 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:23.030768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504bd08-3b85-40bd-b62b-f8314d6e7041 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:23.031148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504bd08-3b85-40bd-b62b-f8314d6e7041 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:23.032543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 168/336] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:23.063773 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 169/337] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:23.067473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98484988-dc23-4831-9ebd-2effb7a80e52 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:23.067711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98484988-dc23-4831-9ebd-2effb7a80e52 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:23.067998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98484988-dc23-4831-9ebd-2effb7a80e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:23.087953 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-98484988-dc23-4831-9ebd-2effb7a80e52 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:23.089181 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-98484988-dc23-4831-9ebd-2effb7a80e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:23.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d8927-7df7-4576-95c4-04e1a07a12e2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:23.157741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:23.242959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 169/338] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:23.278225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98484988-dc23-4831-9ebd-2effb7a80e52 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:23.322827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d8927-7df7-4576-95c4-04e1a07a12e2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:23.372464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ee40b-97b3-4a4d-aa7a-c6c84fb00820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:23.373501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee40b-97b3-4a4d-aa7a-c6c84fb00820 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:23.373933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee40b-97b3-4a4d-aa7a-c6c84fb00820 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:23.374370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee40b-97b3-4a4d-aa7a-c6c84fb00820 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:23.397876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ee40b-97b3-4a4d-aa7a-c6c84fb00820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b94ee40b-97b3-4a4d-aa7a-c6c84fb00820 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:23.402869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:23.403752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:23.404542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 170/339] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:44:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:23.410872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f58622-acad-47a0-a8af-722b820e0d8f None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:23.411074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f58622-acad-47a0-a8af-722b820e0d8f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:23.411496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f58622-acad-47a0-a8af-722b820e0d8f None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:23.413082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 171/340] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:23.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f58622-acad-47a0-a8af-722b820e0d8f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:23.508504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98484988-dc23-4831-9ebd-2effb7a80e52 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:23.522249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:23.565194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f8260-d506-4e3c-b133-0037108f7975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:23.565945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f8260-d506-4e3c-b133-0037108f7975 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:23.566221 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f8260-d506-4e3c-b133-0037108f7975 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:23.567124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f8260-d506-4e3c-b133-0037108f7975 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:23.593289 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f8260-d506-4e3c-b133-0037108f7975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-ce4f8260-d506-4e3c-b133-0037108f7975 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:23.602850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:23.603775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:23.604982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 170/341] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:23.605872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c871-0d05-43d9-a854-a516cd22cda0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:23.605965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c871-0d05-43d9-a854-a516cd22cda0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:23.606991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c871-0d05-43d9-a854-a516cd22cda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:23.630063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:23.643839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b9a3c871-0d05-43d9-a854-a516cd22cda0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:23.645990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f58622-acad-47a0-a8af-722b820e0d8f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:23.648173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b9a3c871-0d05-43d9-a854-a516cd22cda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:23.697862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef70ce-b33f-4065-8a0a-f1a951fce67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:23.698415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef70ce-b33f-4065-8a0a-f1a951fce67a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:23.698700 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef70ce-b33f-4065-8a0a-f1a951fce67a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:23.698977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef70ce-b33f-4065-8a0a-f1a951fce67a None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:23.699700 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef70ce-b33f-4065-8a0a-f1a951fce67a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:23.700006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef70ce-b33f-4065-8a0a-f1a951fce67a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:23.701768 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef70ce-b33f-4065-8a0a-f1a951fce67a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:23.720058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 172/342] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:23.720912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef70ce-b33f-4065-8a0a-f1a951fce67a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:23.795373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 171/343] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:23.796247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3c871-0d05-43d9-a854-a516cd22cda0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:23.935999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef70ce-b33f-4065-8a0a-f1a951fce67a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:23.965559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:23.977987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3c871-0d05-43d9-a854-a516cd22cda0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:23.992077 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aaa11-1300-4bc9-bee8-bd419457b890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:23.992778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aaa11-1300-4bc9-bee8-bd419457b890 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:23.993700 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aaa11-1300-4bc9-bee8-bd419457b890 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:23.993983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aaa11-1300-4bc9-bee8-bd419457b890 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:23.994721 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aaa11-1300-4bc9-bee8-bd419457b890 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:23.995027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aaa11-1300-4bc9-bee8-bd419457b890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:23.996418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aaa11-1300-4bc9-bee8-bd419457b890 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:24.016057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 173/344] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:24.018463 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aaa11-1300-4bc9-bee8-bd419457b890 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:24.034329 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3131e7a-faad-4fda-bce9-874d749edfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:24.035418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3131e7a-faad-4fda-bce9-874d749edfad None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.036401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3131e7a-faad-4fda-bce9-874d749edfad None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.036873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3131e7a-faad-4fda-bce9-874d749edfad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.061303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:24.155688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3131e7a-faad-4fda-bce9-874d749edfad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:24.157705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3131e7a-faad-4fda-bce9-874d749edfad None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:24.182065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aaa11-1300-4bc9-bee8-bd419457b890 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:24.220541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f32ca3-407d-4125-9da5-de5cfb15f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:24.221142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f32ca3-407d-4125-9da5-de5cfb15f0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.221430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f32ca3-407d-4125-9da5-de5cfb15f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.221698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f32ca3-407d-4125-9da5-de5cfb15f0b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.236242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f32ca3-407d-4125-9da5-de5cfb15f0b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-e6f32ca3-407d-4125-9da5-de5cfb15f0b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:24.244728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:24.245788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:24.246583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 174/345] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:24.247276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f32ca3-407d-4125-9da5-de5cfb15f0b5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:24.272555 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:24.282647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 172/346] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:24.284201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df31de-2b24-4398-bc6a-13bc69f10a31 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.284692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df31de-2b24-4398-bc6a-13bc69f10a31 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.285203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df31de-2b24-4398-bc6a-13bc69f10a31 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.287090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 173/347] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:24.288051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df31de-2b24-4398-bc6a-13bc69f10a31 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:24.358031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:24.386311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f32ca3-407d-4125-9da5-de5cfb15f0b5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:24.429300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a918d5-1f18-4109-8af0-9baf3c4f77a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:24.429964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a918d5-1f18-4109-8af0-9baf3c4f77a1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.430244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a918d5-1f18-4109-8af0-9baf3c4f77a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.430518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a918d5-1f18-4109-8af0-9baf3c4f77a1 None admin] PATH_INFO: `/v3/users/6f3ed525294d497fb461bd71da3e0524` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.431762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a918d5-1f18-4109-8af0-9baf3c4f77a1 None admin] RBAC: Authorizing `identity:get_user(user_id=6f3ed525294d497fb461bd71da3e0524)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:24.433306 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a918d5-1f18-4109-8af0-9baf3c4f77a1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:24.435422 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 175/348] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:44:24 2022] GET /identity/v3/users/6f3ed525294d497fb461bd71da3e0524 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:24.436239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a918d5-1f18-4109-8af0-9baf3c4f77a1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:24.447997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df31de-2b24-4398-bc6a-13bc69f10a31 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:24.495789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf26b8-51d9-45cd-b7f2-31076841a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:24.496883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf26b8-51d9-45cd-b7f2-31076841a254 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.497353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf26b8-51d9-45cd-b7f2-31076841a254 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.497768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf26b8-51d9-45cd-b7f2-31076841a254 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.499011 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf26b8-51d9-45cd-b7f2-31076841a254 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:24.499478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf26b8-51d9-45cd-b7f2-31076841a254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:24.501045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf26b8-51d9-45cd-b7f2-31076841a254 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:24.512759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 174/349] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:24.514294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605f3b-172b-49a2-8515-993f5952a9fa None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.514739 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605f3b-172b-49a2-8515-993f5952a9fa None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.515215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605f3b-172b-49a2-8515-993f5952a9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.539443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b7605f3b-172b-49a2-8515-993f5952a9fa None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:24.540958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b7605f3b-172b-49a2-8515-993f5952a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:24.560154 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a918d5-1f18-4109-8af0-9baf3c4f77a1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:24.596399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c90df3-d48b-40da-9c5c-61970590386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:24.597190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c90df3-d48b-40da-9c5c-61970590386f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.597418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c90df3-d48b-40da-9c5c-61970590386f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.597718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c90df3-d48b-40da-9c5c-61970590386f None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.599098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c90df3-d48b-40da-9c5c-61970590386f None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:24.600610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c90df3-d48b-40da-9c5c-61970590386f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:24.602360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 176/350] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:24 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:24.602646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:24.603364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c90df3-d48b-40da-9c5c-61970590386f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:24.623039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 175/351] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:24.624128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7605f3b-172b-49a2-8515-993f5952a9fa None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:24.625066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:24.717319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c90df3-d48b-40da-9c5c-61970590386f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:24.741189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7605f3b-172b-49a2-8515-993f5952a9fa None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:24.756564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51be0c9-244c-4634-94cb-3ff49d823733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:24.757305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51be0c9-244c-4634-94cb-3ff49d823733 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.757705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51be0c9-244c-4634-94cb-3ff49d823733 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.757988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51be0c9-244c-4634-94cb-3ff49d823733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.759254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51be0c9-244c-4634-94cb-3ff49d823733 None admin] RBAC: Adding query filter params (role.id=dd692b78a44b4d12a6e16b7e98674be3, user.id=6f3ed525294d497fb461bd71da3e0524, scope.system=all) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:24.759582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51be0c9-244c-4634-94cb-3ff49d823733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:24.761617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51be0c9-244c-4634-94cb-3ff49d823733 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:24.781150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 177/352] 10.222.0.55 () {56 vars in 1308 bytes} [Mon Jul 25 22:44:24 2022] GET /identity/v3/role_assignments?user.id=6f3ed525294d497fb461bd71da3e0524&scope.system=all&role.id=dd692b78a44b4d12a6e16b7e98674be3 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:24.781150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51be0c9-244c-4634-94cb-3ff49d823733 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:24.797919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3a42c-4e89-4d80-bae9-2d1e5435d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:24.798837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3a42c-4e89-4d80-bae9-2d1e5435d11e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.799262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3a42c-4e89-4d80-bae9-2d1e5435d11e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.799679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3a42c-4e89-4d80-bae9-2d1e5435d11e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.881495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:24.896719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:24.911765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3a42c-4e89-4d80-bae9-2d1e5435d11e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:24.911965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51be0c9-244c-4634-94cb-3ff49d823733 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:24.913723 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3a42c-4e89-4d80-bae9-2d1e5435d11e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:24.953169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa17aa-29d7-4f2e-8549-b05259fcda22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:24.953169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa17aa-29d7-4f2e-8549-b05259fcda22 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.953482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa17aa-29d7-4f2e-8549-b05259fcda22 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.953715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa17aa-29d7-4f2e-8549-b05259fcda22 None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.972012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa17aa-29d7-4f2e-8549-b05259fcda22 None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:24.974645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa17aa-29d7-4f2e-8549-b05259fcda22 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:24.977451 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 178/353] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:24 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:24.978856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa17aa-29d7-4f2e-8549-b05259fcda22 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:25.051433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 176/354] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:25.053141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb5ce-f099-47f2-9056-d7681ab93c05 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:25.057293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb5ce-f099-47f2-9056-d7681ab93c05 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:25.057612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb5ce-f099-47f2-9056-d7681ab93c05 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:25.059397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 177/355] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:25.059923 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb5ce-f099-47f2-9056-d7681ab93c05 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:25.114303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa17aa-29d7-4f2e-8549-b05259fcda22 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:25.162761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ec611-97e9-46f8-8907-d49f5dd6e9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:25.163453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ec611-97e9-46f8-8907-d49f5dd6e9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:25.163732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ec611-97e9-46f8-8907-d49f5dd6e9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:25.164005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ec611-97e9-46f8-8907-d49f5dd6e9b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:25.174085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:25.180731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ec611-97e9-46f8-8907-d49f5dd6e9b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:25.181401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f30ec611-97e9-46f8-8907-d49f5dd6e9b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:25.186312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:25.187312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:25.188141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:25.190078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 179/356] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:25.191093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ec611-97e9-46f8-8907-d49f5dd6e9b5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:25.205105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb5ce-f099-47f2-9056-d7681ab93c05 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:25.249629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ffaf7-377c-4a63-af56-0179bfb44e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:25.250321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ffaf7-377c-4a63-af56-0179bfb44e10 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:25.250606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ffaf7-377c-4a63-af56-0179bfb44e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:25.250878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ffaf7-377c-4a63-af56-0179bfb44e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:25.251674 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ffaf7-377c-4a63-af56-0179bfb44e10 None admin] RBAC: Adding query filter params (group.id=48128f862dff4c7e8fca543fc607c3d1, role.id=0cb8656b530647bea1bc161edf344c96, scope.project.id=048254d114684a7e8e71048df03aaf23) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:25.251988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ffaf7-377c-4a63-af56-0179bfb44e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:25.253474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ffaf7-377c-4a63-af56-0179bfb44e10 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:25.263252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 178/357] 10.222.0.55 () {56 vars in 1376 bytes} [Mon Jul 25 22:44:25 2022] GET /identity/v3/role_assignments?group.id=48128f862dff4c7e8fca543fc607c3d1&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=0cb8656b530647bea1bc161edf344c96 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:25.264352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1ca6d-ff7d-4430-815f-1e3bc2fa79c5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:25.264637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1ca6d-ff7d-4430-815f-1e3bc2fa79c5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:25.267885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1ca6d-ff7d-4430-815f-1e3bc2fa79c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:25.290684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2fd1ca6d-ff7d-4430-815f-1e3bc2fa79c5 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:25.291992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2fd1ca6d-ff7d-4430-815f-1e3bc2fa79c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:25.349254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ec611-97e9-46f8-8907-d49f5dd6e9b5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:25.397098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 179/358] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:25.398662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e95f6-2619-4f31-915b-05a3325673cb None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:25.399009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e95f6-2619-4f31-915b-05a3325673cb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:25.399334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e95f6-2619-4f31-915b-05a3325673cb None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:25.400840 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 180/359] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:25.402853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e95f6-2619-4f31-915b-05a3325673cb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:25.406559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60456e-7871-4d94-8d3a-5be0d1f7e063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:25.407532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60456e-7871-4d94-8d3a-5be0d1f7e063 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:25.407950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60456e-7871-4d94-8d3a-5be0d1f7e063 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:25.408362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60456e-7871-4d94-8d3a-5be0d1f7e063 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:25.409865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60456e-7871-4d94-8d3a-5be0d1f7e063 None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:25.411866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60456e-7871-4d94-8d3a-5be0d1f7e063 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:25.414217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 180/360] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:25 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:25.415462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792dd20-f8ab-4575-96fc-fb4b29292628 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:25.415822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792dd20-f8ab-4575-96fc-fb4b29292628 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:25.416229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792dd20-f8ab-4575-96fc-fb4b29292628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:25.446983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d792dd20-f8ab-4575-96fc-fb4b29292628 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:25.447601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d792dd20-f8ab-4575-96fc-fb4b29292628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:25.532287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:25.542457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:25.553037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 181/361] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:25.554457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792dd20-f8ab-4575-96fc-fb4b29292628 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:25.570970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e95f6-2619-4f31-915b-05a3325673cb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:25.623302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21080b-54b8-47f5-9dae-78dd527b0ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:25.624175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21080b-54b8-47f5-9dae-78dd527b0ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:25.624614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21080b-54b8-47f5-9dae-78dd527b0ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:25.625025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21080b-54b8-47f5-9dae-78dd527b0ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:25.626540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21080b-54b8-47f5-9dae-78dd527b0ab0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:25.627293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21080b-54b8-47f5-9dae-78dd527b0ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:25.630410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21080b-54b8-47f5-9dae-78dd527b0ab0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:25.642018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 181/362] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:25.643645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21080b-54b8-47f5-9dae-78dd527b0ab0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:25.692358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792dd20-f8ab-4575-96fc-fb4b29292628 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:25.747016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf6a9d-0c32-4956-9289-d371894b7b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:25.747217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf6a9d-0c32-4956-9289-d371894b7b62 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:25.750285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf6a9d-0c32-4956-9289-d371894b7b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:25.750285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf6a9d-0c32-4956-9289-d371894b7b62 None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:25.752185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf6a9d-0c32-4956-9289-d371894b7b62 None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:25.757302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf6a9d-0c32-4956-9289-d371894b7b62 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:25.757302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 182/363] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:25 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:25.757302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf6a9d-0c32-4956-9289-d371894b7b62 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:25.797249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21080b-54b8-47f5-9dae-78dd527b0ab0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:25.852831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6e5d2-e366-4dfc-8296-d7d6e6d53e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:25.856276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e5d2-e366-4dfc-8296-d7d6e6d53e9d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:25.856276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e5d2-e366-4dfc-8296-d7d6e6d53e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:25.856276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e5d2-e366-4dfc-8296-d7d6e6d53e9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:25.878593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6e5d2-e366-4dfc-8296-d7d6e6d53e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:25.879623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-46d6e5d2-e366-4dfc-8296-d7d6e6d53e9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:25.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:25.888383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 182/364] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:44:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:25.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6e5d2-e366-4dfc-8296-d7d6e6d53e9d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:25.897502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:25.959573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf6a9d-0c32-4956-9289-d371894b7b62 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:26.007464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949193db-c2ae-467a-9499-885ae9e3be3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:26.008138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949193db-c2ae-467a-9499-885ae9e3be3d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:26.008395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949193db-c2ae-467a-9499-885ae9e3be3d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:26.008667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949193db-c2ae-467a-9499-885ae9e3be3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:26.027541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949193db-c2ae-467a-9499-885ae9e3be3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-949193db-c2ae-467a-9499-885ae9e3be3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:26.033026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:26.033962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:26.034727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 183/365] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:26.035969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949193db-c2ae-467a-9499-885ae9e3be3d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:26.051499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6e5d2-e366-4dfc-8296-d7d6e6d53e9d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:26.099624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a09a-5713-471b-84ee-e508a5e94073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:26.100258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a09a-5713-471b-84ee-e508a5e94073 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:26.100542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a09a-5713-471b-84ee-e508a5e94073 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:26.100820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a09a-5713-471b-84ee-e508a5e94073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:26.169220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949193db-c2ae-467a-9499-885ae9e3be3d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:26.190957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a09a-5713-471b-84ee-e508a5e94073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:26.190957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a09a-5713-471b-84ee-e508a5e94073 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:26.193268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:26.199751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:26.213311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396b4c-6fb7-473d-a1b5-05c05be35e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:26.213865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396b4c-6fb7-473d-a1b5-05c05be35e44 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:26.214143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396b4c-6fb7-473d-a1b5-05c05be35e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:26.214417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396b4c-6fb7-473d-a1b5-05c05be35e44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:26.215369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e396b4c-6fb7-473d-a1b5-05c05be35e44 None admin] RBAC: Adding query filter params (group.id=48128f862dff4c7e8fca543fc607c3d1, role.id=8458ab7384a043d2a03698163d3892fd, scope.project.id=048254d114684a7e8e71048df03aaf23) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:26.215547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e396b4c-6fb7-473d-a1b5-05c05be35e44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:26.217012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e396b4c-6fb7-473d-a1b5-05c05be35e44 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:26.224671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 184/366] 10.222.0.55 () {56 vars in 1376 bytes} [Mon Jul 25 22:44:26 2022] GET /identity/v3/role_assignments?group.id=48128f862dff4c7e8fca543fc607c3d1&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=8458ab7384a043d2a03698163d3892fd => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:26.225839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396b4c-6fb7-473d-a1b5-05c05be35e44 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:26.354660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 183/367] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:26.355633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a09a-5713-471b-84ee-e508a5e94073 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:26.374344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396b4c-6fb7-473d-a1b5-05c05be35e44 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:26.425570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dc9df-f670-4307-be1e-621b80170a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:26.426704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dc9df-f670-4307-be1e-621b80170a31 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:26.427466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dc9df-f670-4307-be1e-621b80170a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:26.427750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dc9df-f670-4307-be1e-621b80170a31 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:26.429022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dc9df-f670-4307-be1e-621b80170a31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:26.429398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dc9df-f670-4307-be1e-621b80170a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:26.431124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dc9df-f670-4307-be1e-621b80170a31 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:26.443113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 185/368] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:26.444091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dc9df-f670-4307-be1e-621b80170a31 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:26.498349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a09a-5713-471b-84ee-e508a5e94073 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:26.500429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:26.513519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:26.551409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4a202-e9df-4c7a-9c11-f1bd96e434d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:26.552409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4a202-e9df-4c7a-9c11-f1bd96e434d3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:26.552693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4a202-e9df-4c7a-9c11-f1bd96e434d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:26.552972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4a202-e9df-4c7a-9c11-f1bd96e434d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:26.555148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4a202-e9df-4c7a-9c11-f1bd96e434d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:26.555466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4a202-e9df-4c7a-9c11-f1bd96e434d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:26.556943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4a202-e9df-4c7a-9c11-f1bd96e434d3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:26.568711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 184/369] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:26.569554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4a202-e9df-4c7a-9c11-f1bd96e434d3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:26.602028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dc9df-f670-4307-be1e-621b80170a31 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:26.653928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972f1e0-ec06-412c-9a76-e4222f138481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:26.654664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972f1e0-ec06-412c-9a76-e4222f138481 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:26.654949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972f1e0-ec06-412c-9a76-e4222f138481 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:26.655219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972f1e0-ec06-412c-9a76-e4222f138481 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:26.656426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972f1e0-ec06-412c-9a76-e4222f138481 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:26.657936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972f1e0-ec06-412c-9a76-e4222f138481 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:26.661280 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 186/370] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:26 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:26.661433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972f1e0-ec06-412c-9a76-e4222f138481 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:26.716073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4a202-e9df-4c7a-9c11-f1bd96e434d3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:26.766520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11211786-551a-4fc9-a4a4-6284e65f0f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:26.767556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211786-551a-4fc9-a4a4-6284e65f0f32 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:26.768188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211786-551a-4fc9-a4a4-6284e65f0f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:26.768684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211786-551a-4fc9-a4a4-6284e65f0f32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:26.798839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972f1e0-ec06-412c-9a76-e4222f138481 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:26.812836 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:26.826183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:26.855098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4440e3-d75f-42d3-a445-5e93b105498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:26.859699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4440e3-d75f-42d3-a445-5e93b105498f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:26.859699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4440e3-d75f-42d3-a445-5e93b105498f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:26.859699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4440e3-d75f-42d3-a445-5e93b105498f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:26.865181 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11211786-551a-4fc9-a4a4-6284e65f0f32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:26.865518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11211786-551a-4fc9-a4a4-6284e65f0f32 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:26.961524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4440e3-d75f-42d3-a445-5e93b105498f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:26.964132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4440e3-d75f-42d3-a445-5e93b105498f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:27.011879 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 185/371] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:27.012685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11211786-551a-4fc9-a4a4-6284e65f0f32 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:27.104699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 187/372] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:27.106004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:27.106660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4440e3-d75f-42d3-a445-5e93b105498f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:27.132981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:27.160856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11211786-551a-4fc9-a4a4-6284e65f0f32 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:27.215836 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dbbb9-ac50-4cc8-af9c-5025d849c6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:27.217104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dbbb9-ac50-4cc8-af9c-5025d849c6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.217612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dbbb9-ac50-4cc8-af9c-5025d849c6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.218083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dbbb9-ac50-4cc8-af9c-5025d849c6c8 None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.219548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dbbb9-ac50-4cc8-af9c-5025d849c6c8 None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:27.221462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dbbb9-ac50-4cc8-af9c-5025d849c6c8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:27.224504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 186/373] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:27 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:27.225777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dbbb9-ac50-4cc8-af9c-5025d849c6c8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:27.235836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4440e3-d75f-42d3-a445-5e93b105498f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:27.281481 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba36d9-a5d2-448e-b8e0-795c4a17355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:27.282052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba36d9-a5d2-448e-b8e0-795c4a17355a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.282655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba36d9-a5d2-448e-b8e0-795c4a17355a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.282971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba36d9-a5d2-448e-b8e0-795c4a17355a None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.284415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba36d9-a5d2-448e-b8e0-795c4a17355a None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:27.286139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba36d9-a5d2-448e-b8e0-795c4a17355a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:27.288839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 188/374] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:27 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:27.289675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba36d9-a5d2-448e-b8e0-795c4a17355a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:27.357341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dbbb9-ac50-4cc8-af9c-5025d849c6c8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:27.393301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:27.398998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:27.402005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c42339-5230-43c9-935b-d9d68c7688dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:27.402905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c42339-5230-43c9-935b-d9d68c7688dc None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.403387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c42339-5230-43c9-935b-d9d68c7688dc None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.403853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c42339-5230-43c9-935b-d9d68c7688dc None admin] PATH_INFO: `/v3/projects/95854b83c1ee4dca86942110e1c80272` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.405333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c42339-5230-43c9-935b-d9d68c7688dc None admin] RBAC: Authorizing `identity:get_project(project_id=95854b83c1ee4dca86942110e1c80272)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:27.406981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c42339-5230-43c9-935b-d9d68c7688dc None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:27.418293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 187/375] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:27 2022] GET /identity/v3/projects/95854b83c1ee4dca86942110e1c80272 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:27.418293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c42339-5230-43c9-935b-d9d68c7688dc None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:27.418484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba36d9-a5d2-448e-b8e0-795c4a17355a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:27.471278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a34fb-0d6a-4d58-b797-07804e08de71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:27.472235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a34fb-0d6a-4d58-b797-07804e08de71 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.473367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a34fb-0d6a-4d58-b797-07804e08de71 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.473820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a34fb-0d6a-4d58-b797-07804e08de71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.475042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a34fb-0d6a-4d58-b797-07804e08de71 None admin] RBAC: Adding query filter params (group.id=48128f862dff4c7e8fca543fc607c3d1, role.id=8458ab7384a043d2a03698163d3892fd, scope.project.id=5c21175d79504afbab1ea1c1297c36f6) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:27.476397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a34fb-0d6a-4d58-b797-07804e08de71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:27.478888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a34fb-0d6a-4d58-b797-07804e08de71 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:27.486191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 189/376] 10.222.0.55 () {56 vars in 1376 bytes} [Mon Jul 25 22:44:27 2022] GET /identity/v3/role_assignments?group.id=48128f862dff4c7e8fca543fc607c3d1&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=8458ab7384a043d2a03698163d3892fd => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:27.487422 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a34fb-0d6a-4d58-b797-07804e08de71 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:27.586853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c42339-5230-43c9-935b-d9d68c7688dc None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:27.645114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a34fb-0d6a-4d58-b797-07804e08de71 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:27.653972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d68cb-06ed-4adc-aa97-6e47f1138974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:27.654752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d68cb-06ed-4adc-aa97-6e47f1138974 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.655110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d68cb-06ed-4adc-aa97-6e47f1138974 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.655479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d68cb-06ed-4adc-aa97-6e47f1138974 None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.656920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d68cb-06ed-4adc-aa97-6e47f1138974 None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:27.662936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d68cb-06ed-4adc-aa97-6e47f1138974 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:27.664594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 188/377] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:27 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:27.670376 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d68cb-06ed-4adc-aa97-6e47f1138974 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:27.716880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d15db-849d-490f-898a-5066c56e997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:27.718304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d15db-849d-490f-898a-5066c56e997a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.719006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d15db-849d-490f-898a-5066c56e997a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.719696 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d15db-849d-490f-898a-5066c56e997a None admin] PATH_INFO: `/v3/groups/c3c4cd6852154adb94cbac6d95401c84` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.728710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d15db-849d-490f-898a-5066c56e997a None admin] RBAC: Authorizing `identity:get_group(group_id=c3c4cd6852154adb94cbac6d95401c84)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:27.731820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d15db-849d-490f-898a-5066c56e997a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:27.735446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 190/378] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:27 2022] GET /identity/v3/groups/c3c4cd6852154adb94cbac6d95401c84 => generated 229 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:27.737881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794471c-dbd2-417c-a624-f06becf35d4c None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.739246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794471c-dbd2-417c-a624-f06becf35d4c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.740151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794471c-dbd2-417c-a624-f06becf35d4c None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.742970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 191/379] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:27.744515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794471c-dbd2-417c-a624-f06becf35d4c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:27.775230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:27.798569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:27.846125 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d68cb-06ed-4adc-aa97-6e47f1138974 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:27.890112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794471c-dbd2-417c-a624-f06becf35d4c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:27.890362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7c86c-644a-4d86-9fef-397c422fc1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:27.890873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c86c-644a-4d86-9fef-397c422fc1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.891152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c86c-644a-4d86-9fef-397c422fc1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.891425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c86c-644a-4d86-9fef-397c422fc1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.892221 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7c86c-644a-4d86-9fef-397c422fc1f5 None admin] RBAC: Adding query filter params (group.id=48128f862dff4c7e8fca543fc607c3d1, role.id=0cb8656b530647bea1bc161edf344c96, scope.project.id=5c21175d79504afbab1ea1c1297c36f6) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:27.892527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7c86c-644a-4d86-9fef-397c422fc1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:27.894661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7c86c-644a-4d86-9fef-397c422fc1f5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:27.900500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 189/380] 10.222.0.55 () {56 vars in 1376 bytes} [Mon Jul 25 22:44:27 2022] GET /identity/v3/role_assignments?group.id=48128f862dff4c7e8fca543fc607c3d1&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=0cb8656b530647bea1bc161edf344c96 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:27.901777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21f75-68c5-41ac-bb83-bce0ff8419a0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.902065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21f75-68c5-41ac-bb83-bce0ff8419a0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.902339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21f75-68c5-41ac-bb83-bce0ff8419a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.922666 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9af21f75-68c5-41ac-bb83-bce0ff8419a0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:27.923858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9af21f75-68c5-41ac-bb83-bce0ff8419a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:27.934105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67099bef-6225-4a97-8b34-fef135767f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:27.934990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099bef-6225-4a97-8b34-fef135767f31 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.935472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099bef-6225-4a97-8b34-fef135767f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.935922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099bef-6225-4a97-8b34-fef135767f31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.936951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67099bef-6225-4a97-8b34-fef135767f31 None admin] RBAC: Adding query filter params (group.id=c3c4cd6852154adb94cbac6d95401c84, role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=95854b83c1ee4dca86942110e1c80272) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:27.937443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67099bef-6225-4a97-8b34-fef135767f31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:27.939185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67099bef-6225-4a97-8b34-fef135767f31 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:27.948216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 192/381] 10.222.0.55 () {56 vars in 1376 bytes} [Mon Jul 25 22:44:27 2022] GET /identity/v3/role_assignments?group.id=c3c4cd6852154adb94cbac6d95401c84&scope.project.id=95854b83c1ee4dca86942110e1c80272&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:28.035650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 190/382] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:28.072826 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67099bef-6225-4a97-8b34-fef135767f31 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:28.200498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:28.228381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67099bef-6225-4a97-8b34-fef135767f31 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:28.269162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051ef0-cd35-41c7-b058-bbc31901b8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:28.270339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051ef0-cd35-41c7-b058-bbc31901b8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:28.270710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051ef0-cd35-41c7-b058-bbc31901b8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:28.271199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051ef0-cd35-41c7-b058-bbc31901b8c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:28.283211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c051ef0-cd35-41c7-b058-bbc31901b8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2c051ef0-cd35-41c7-b058-bbc31901b8c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:28.289972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:28.290909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:28.292127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 193/383] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:44:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:28.297392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af21f75-68c5-41ac-bb83-bce0ff8419a0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:28.383944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:28.433305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af21f75-68c5-41ac-bb83-bce0ff8419a0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:28.475155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492926f-af9d-4ec6-ab61-13251adbf345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:28.475700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492926f-af9d-4ec6-ab61-13251adbf345 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:28.476076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492926f-af9d-4ec6-ab61-13251adbf345 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:28.476415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492926f-af9d-4ec6-ab61-13251adbf345 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:28.477200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492926f-af9d-4ec6-ab61-13251adbf345 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:28.477506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492926f-af9d-4ec6-ab61-13251adbf345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:28.479009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492926f-af9d-4ec6-ab61-13251adbf345 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:28.491695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 191/384] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:28.497492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051ef0-cd35-41c7-b058-bbc31901b8c5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:28.618229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051ef0-cd35-41c7-b058-bbc31901b8c5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:28.664409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f64e7-4367-42d9-b8bc-b24e7fcad913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:28.665054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f64e7-4367-42d9-b8bc-b24e7fcad913 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:28.665359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f64e7-4367-42d9-b8bc-b24e7fcad913 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:28.665632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f64e7-4367-42d9-b8bc-b24e7fcad913 None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:28.666833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f64e7-4367-42d9-b8bc-b24e7fcad913 None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:28.668337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f64e7-4367-42d9-b8bc-b24e7fcad913 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:28.670400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 194/385] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:28 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:28.677376 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492926f-af9d-4ec6-ab61-13251adbf345 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:28.789697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492926f-af9d-4ec6-ab61-13251adbf345 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:28.825558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:28.846928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc975470-150f-48f8-afd3-18ada3acc8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:28.847597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc975470-150f-48f8-afd3-18ada3acc8ac None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:28.848498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc975470-150f-48f8-afd3-18ada3acc8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:28.848981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc975470-150f-48f8-afd3-18ada3acc8ac None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:28.858569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc975470-150f-48f8-afd3-18ada3acc8ac None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:28.860082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc975470-150f-48f8-afd3-18ada3acc8ac None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:28.862186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 192/386] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:28 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:28.869330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f64e7-4367-42d9-b8bc-b24e7fcad913 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:28.873929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316a6a0-208a-41f0-8d2a-e5d8bad79328 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:28.874215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316a6a0-208a-41f0-8d2a-e5d8bad79328 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:28.874504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316a6a0-208a-41f0-8d2a-e5d8bad79328 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:28.876217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 193/387] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:28.881304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:28.881894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb6b1-15cc-468d-95d9-067b117278f4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:28.882189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb6b1-15cc-468d-95d9-067b117278f4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:28.882771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb6b1-15cc-468d-95d9-067b117278f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:28.912656 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f3ceb6b1-15cc-468d-95d9-067b117278f4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:28.914209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f3ceb6b1-15cc-468d-95d9-067b117278f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:28.994488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f64e7-4367-42d9-b8bc-b24e7fcad913 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:29.033509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8a078-54f7-4063-bf23-c87ccda9f597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:29.034206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8a078-54f7-4063-bf23-c87ccda9f597 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:29.034487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8a078-54f7-4063-bf23-c87ccda9f597 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:29.034767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8a078-54f7-4063-bf23-c87ccda9f597 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23/groups/48128f862dff4c7e8fca543fc607c3d1/roles/0cb8656b530647bea1bc161edf344c96` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:29.038753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8a078-54f7-4063-bf23-c87ccda9f597 None admin] RBAC: Authorizing `identity:create_grant(project_id=048254d114684a7e8e71048df03aaf23, group_id=48128f862dff4c7e8fca543fc607c3d1, role_id=0cb8656b530647bea1bc161edf344c96)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:29.040409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8a078-54f7-4063-bf23-c87ccda9f597 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:29.066333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 194/388] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:29.091994 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb6b1-15cc-468d-95d9-067b117278f4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:29.138387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 195/389] 10.222.0.55 () {58 vars in 1442 bytes} [Mon Jul 25 22:44:28 2022] PUT /identity/v3/projects/048254d114684a7e8e71048df03aaf23/groups/48128f862dff4c7e8fca543fc607c3d1/roles/0cb8656b530647bea1bc161edf344c96 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:29.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb6b1-15cc-468d-95d9-067b117278f4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:29.283655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:29.300025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba44e0-8d88-4bcc-90c7-45ce9ec6f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:29.300633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba44e0-8d88-4bcc-90c7-45ce9ec6f170 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:29.300921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba44e0-8d88-4bcc-90c7-45ce9ec6f170 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:29.302650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba44e0-8d88-4bcc-90c7-45ce9ec6f170 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:29.317955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba44e0-8d88-4bcc-90c7-45ce9ec6f170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-52ba44e0-8d88-4bcc-90c7-45ce9ec6f170 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:29.323044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:29.323928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:29.324717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:29.326361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 195/390] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:29.333515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8a078-54f7-4063-bf23-c87ccda9f597 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:29.429427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:29.484855 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8a078-54f7-4063-bf23-c87ccda9f597 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:29.531572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465953-dbb9-4c41-85e2-531670ecbb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:29.532220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465953-dbb9-4c41-85e2-531670ecbb45 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:29.532504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465953-dbb9-4c41-85e2-531670ecbb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:29.532777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465953-dbb9-4c41-85e2-531670ecbb45 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:29.533563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465953-dbb9-4c41-85e2-531670ecbb45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:29.533872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465953-dbb9-4c41-85e2-531670ecbb45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:29.541615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465953-dbb9-4c41-85e2-531670ecbb45 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:29.553318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 196/391] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:29.558703 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba44e0-8d88-4bcc-90c7-45ce9ec6f170 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:29.702300 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba44e0-8d88-4bcc-90c7-45ce9ec6f170 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:29.749846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bb153-8686-4a53-a292-c1d311210deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:29.750629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bb153-8686-4a53-a292-c1d311210deb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:29.750918 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bb153-8686-4a53-a292-c1d311210deb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:29.751199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bb153-8686-4a53-a292-c1d311210deb None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:29.752513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bb153-8686-4a53-a292-c1d311210deb None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:29.754824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bb153-8686-4a53-a292-c1d311210deb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:29.756750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 196/392] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:29 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:29.762434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465953-dbb9-4c41-85e2-531670ecbb45 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:29.923182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465953-dbb9-4c41-85e2-531670ecbb45 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:29.960932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:29.969267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7bb77-c08e-4270-9eb3-dc1009d85df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:29.969930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7bb77-c08e-4270-9eb3-dc1009d85df2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:29.970212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7bb77-c08e-4270-9eb3-dc1009d85df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:29.970492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7bb77-c08e-4270-9eb3-dc1009d85df2 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:29.971688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7bb77-c08e-4270-9eb3-dc1009d85df2 None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:29.974493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7bb77-c08e-4270-9eb3-dc1009d85df2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:29.976428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 197/393] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:29 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:29.982202 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bb153-8686-4a53-a292-c1d311210deb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:30.039778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:30.104959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bb153-8686-4a53-a292-c1d311210deb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:30.166443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f987bc1-2227-43cf-b6b8-b1205d09fe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:30.167067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987bc1-2227-43cf-b6b8-b1205d09fe75 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:30.167348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987bc1-2227-43cf-b6b8-b1205d09fe75 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:30.167622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987bc1-2227-43cf-b6b8-b1205d09fe75 None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23/groups/48128f862dff4c7e8fca543fc607c3d1/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:30.169723 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f987bc1-2227-43cf-b6b8-b1205d09fe75 None admin] RBAC: Authorizing `identity:create_grant(project_id=048254d114684a7e8e71048df03aaf23, group_id=48128f862dff4c7e8fca543fc607c3d1, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:30.171285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f987bc1-2227-43cf-b6b8-b1205d09fe75 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:30.247725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 197/394] 10.222.0.55 () {58 vars in 1442 bytes} [Mon Jul 25 22:44:29 2022] PUT /identity/v3/projects/048254d114684a7e8e71048df03aaf23/groups/48128f862dff4c7e8fca543fc607c3d1/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:30.512923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5467767-8021-4fc6-ac74-eeee51032924 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:30.514055 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5467767-8021-4fc6-ac74-eeee51032924 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:30.514587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5467767-8021-4fc6-ac74-eeee51032924 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:30.516720 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 198/395] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:30.523928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75baf5c7-4892-4c12-8cfd-e047e97ee20e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:30.524906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75baf5c7-4892-4c12-8cfd-e047e97ee20e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:30.525420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75baf5c7-4892-4c12-8cfd-e047e97ee20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:30.554322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-75baf5c7-4892-4c12-8cfd-e047e97ee20e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:30.555947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-75baf5c7-4892-4c12-8cfd-e047e97ee20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:30.590066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb564a-71ac-429a-9efa-0acb74e3d065 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:30.590718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb564a-71ac-429a-9efa-0acb74e3d065 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:30.591189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb564a-71ac-429a-9efa-0acb74e3d065 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:30.593203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 199/396] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:44:30.600665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652be84-4019-4efd-83d1-36f73afa7bf9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:30.601316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652be84-4019-4efd-83d1-36f73afa7bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:30.601819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652be84-4019-4efd-83d1-36f73afa7bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:30.622002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a652be84-4019-4efd-83d1-36f73afa7bf9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:30.623620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a652be84-4019-4efd-83d1-36f73afa7bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:30.665813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 198/397] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:30.688668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75baf5c7-4892-4c12-8cfd-e047e97ee20e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:30.741789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 200/398] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:30.758293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:30.781897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652be84-4019-4efd-83d1-36f73afa7bf9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:30.866070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75baf5c7-4892-4c12-8cfd-e047e97ee20e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:30.940415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb375ff0-7dd1-4420-95b9-5e4dc74cdd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:30.941075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb375ff0-7dd1-4420-95b9-5e4dc74cdd5c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:30.942409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb375ff0-7dd1-4420-95b9-5e4dc74cdd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:30.943142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb375ff0-7dd1-4420-95b9-5e4dc74cdd5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:30.965854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb375ff0-7dd1-4420-95b9-5e4dc74cdd5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-cb375ff0-7dd1-4420-95b9-5e4dc74cdd5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:30.970820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:30.971755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:30.972584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 199/399] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:44:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:30.979039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb375ff0-7dd1-4420-95b9-5e4dc74cdd5c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:30.989648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652be84-4019-4efd-83d1-36f73afa7bf9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:31.024921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:31.040236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f1d7e-e540-48fe-b950-7b4491b40212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:31.040236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f1d7e-e540-48fe-b950-7b4491b40212 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.040236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f1d7e-e540-48fe-b950-7b4491b40212 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.040236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f1d7e-e540-48fe-b950-7b4491b40212 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.049089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f1d7e-e540-48fe-b950-7b4491b40212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-8f8f1d7e-e540-48fe-b950-7b4491b40212 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:31.055365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:31.056491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:31.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:31.060668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 201/400] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:31.062214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2993bc-f52a-409e-b98b-92ce3b221b88 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.062745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2993bc-f52a-409e-b98b-92ce3b221b88 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.063303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2993bc-f52a-409e-b98b-92ce3b221b88 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.065528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 202/401] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:31.067404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2993bc-f52a-409e-b98b-92ce3b221b88 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:31.125620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:31.130593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb375ff0-7dd1-4420-95b9-5e4dc74cdd5c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:31.181270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2747a29-2fbd-47d3-b1ea-5d542deab2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:31.182150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2747a29-2fbd-47d3-b1ea-5d542deab2ae None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.182693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2747a29-2fbd-47d3-b1ea-5d542deab2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.183132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2747a29-2fbd-47d3-b1ea-5d542deab2ae None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.184000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2747a29-2fbd-47d3-b1ea-5d542deab2ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:31.184453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2747a29-2fbd-47d3-b1ea-5d542deab2ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:31.186041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2747a29-2fbd-47d3-b1ea-5d542deab2ae None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:31.196076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 200/402] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:31.197828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66109df-887e-4987-8bfe-8fbe39e61443 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.198333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66109df-887e-4987-8bfe-8fbe39e61443 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.198823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66109df-887e-4987-8bfe-8fbe39e61443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.214805 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2993bc-f52a-409e-b98b-92ce3b221b88 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:31.220302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e66109df-887e-4987-8bfe-8fbe39e61443 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:31.221862 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e66109df-887e-4987-8bfe-8fbe39e61443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:31.261031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c4e47-7149-4dc9-be56-99e2bdc762dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:31.261692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c4e47-7149-4dc9-be56-99e2bdc762dc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.262053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c4e47-7149-4dc9-be56-99e2bdc762dc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.262336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c4e47-7149-4dc9-be56-99e2bdc762dc None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.263212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c4e47-7149-4dc9-be56-99e2bdc762dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:31.263520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c4e47-7149-4dc9-be56-99e2bdc762dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:31.265033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c4e47-7149-4dc9-be56-99e2bdc762dc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:31.276756 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 203/403] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:31.277933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c4e47-7149-4dc9-be56-99e2bdc762dc None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:31.317984 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 201/404] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:31.318470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66109df-887e-4987-8bfe-8fbe39e61443 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:31.333739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:31.391566 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c4e47-7149-4dc9-be56-99e2bdc762dc None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:31.430156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0529d-5f1e-41df-a263-3d10b7c0cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:31.431097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0529d-5f1e-41df-a263-3d10b7c0cbda None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.431519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0529d-5f1e-41df-a263-3d10b7c0cbda None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.431932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0529d-5f1e-41df-a263-3d10b7c0cbda None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.433343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0529d-5f1e-41df-a263-3d10b7c0cbda None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:31.435040 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0529d-5f1e-41df-a263-3d10b7c0cbda None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:31.436917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 204/405] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:31 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:31.438017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0529d-5f1e-41df-a263-3d10b7c0cbda None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:31.439175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:31.450683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66109df-887e-4987-8bfe-8fbe39e61443 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:31.491272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2d206-2bd4-4d50-a418-b859101bdf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:31.492023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2d206-2bd4-4d50-a418-b859101bdf99 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.492378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2d206-2bd4-4d50-a418-b859101bdf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.492725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2d206-2bd4-4d50-a418-b859101bdf99 None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.494607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2d206-2bd4-4d50-a418-b859101bdf99 None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:31.497300 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2d206-2bd4-4d50-a418-b859101bdf99 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:31.499425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 202/406] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:31 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:31.500543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2d206-2bd4-4d50-a418-b859101bdf99 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:31.573843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0529d-5f1e-41df-a263-3d10b7c0cbda None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:31.593526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:31.613356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90d207-0d3d-4eed-9f92-8250352620da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:31.614522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90d207-0d3d-4eed-9f92-8250352620da None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.614804 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90d207-0d3d-4eed-9f92-8250352620da None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.615080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90d207-0d3d-4eed-9f92-8250352620da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.630170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90d207-0d3d-4eed-9f92-8250352620da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:31.631213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2d206-2bd4-4d50-a418-b859101bdf99 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-db90d207-0d3d-4eed-9f92-8250352620da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:31.636014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:31.636913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 205/407] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:44:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:31.645471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90d207-0d3d-4eed-9f92-8250352620da None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:31.677560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd45763-b81b-4c4c-9d6c-996178cf88b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:31.678492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd45763-b81b-4c4c-9d6c-996178cf88b9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.678831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd45763-b81b-4c4c-9d6c-996178cf88b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.679109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd45763-b81b-4c4c-9d6c-996178cf88b9 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.680911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd45763-b81b-4c4c-9d6c-996178cf88b9 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:31.682525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd45763-b81b-4c4c-9d6c-996178cf88b9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:31.684473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 203/408] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:31 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:31.686008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec6671-af7a-45fa-8aeb-d1e90ec07ed7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.686008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec6671-af7a-45fa-8aeb-d1e90ec07ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.686276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec6671-af7a-45fa-8aeb-d1e90ec07ed7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.689244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 204/409] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:31.689244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec6671-af7a-45fa-8aeb-d1e90ec07ed7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:31.739693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:31.769187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90d207-0d3d-4eed-9f92-8250352620da None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:31.814260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd235127-e5e8-4c2b-92bb-87aa7018ea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:31.814922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd235127-e5e8-4c2b-92bb-87aa7018ea80 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.815198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd235127-e5e8-4c2b-92bb-87aa7018ea80 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.815471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd235127-e5e8-4c2b-92bb-87aa7018ea80 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.817978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd235127-e5e8-4c2b-92bb-87aa7018ea80 None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:31.819429 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd235127-e5e8-4c2b-92bb-87aa7018ea80 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:31.825704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 206/410] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:31 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:31.825704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd235127-e5e8-4c2b-92bb-87aa7018ea80 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:31.862113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec6671-af7a-45fa-8aeb-d1e90ec07ed7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:31.907216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:31.921287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5607c-ec8d-4a55-bd10-1157af5b57f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:31.921910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5607c-ec8d-4a55-bd10-1157af5b57f3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.924441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5607c-ec8d-4a55-bd10-1157af5b57f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.924441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5607c-ec8d-4a55-bd10-1157af5b57f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.924441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5607c-ec8d-4a55-bd10-1157af5b57f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:31.924441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5607c-ec8d-4a55-bd10-1157af5b57f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:31.924814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5607c-ec8d-4a55-bd10-1157af5b57f3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:31.934523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 205/411] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:31.935748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149d58-4936-47b6-bb3d-4f26267a4a39 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:31.936028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149d58-4936-47b6-bb3d-4f26267a4a39 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:31.936301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149d58-4936-47b6-bb3d-4f26267a4a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:31.954452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fd149d58-4936-47b6-bb3d-4f26267a4a39 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:31.955652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fd149d58-4936-47b6-bb3d-4f26267a4a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:31.977767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd235127-e5e8-4c2b-92bb-87aa7018ea80 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:32.012926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78538a69-46d9-4357-93eb-8686b1700c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:32.013640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538a69-46d9-4357-93eb-8686b1700c34 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.013932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538a69-46d9-4357-93eb-8686b1700c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.014215 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538a69-46d9-4357-93eb-8686b1700c34 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6/groups/48128f862dff4c7e8fca543fc607c3d1/roles/0cb8656b530647bea1bc161edf344c96` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.017057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78538a69-46d9-4357-93eb-8686b1700c34 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c21175d79504afbab1ea1c1297c36f6, group_id=48128f862dff4c7e8fca543fc607c3d1, role_id=0cb8656b530647bea1bc161edf344c96)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:32.018542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78538a69-46d9-4357-93eb-8686b1700c34 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:32.033111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 206/412] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:32.033978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd149d58-4936-47b6-bb3d-4f26267a4a39 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:32.057573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:32.131104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 207/413] 10.222.0.55 () {58 vars in 1442 bytes} [Mon Jul 25 22:44:31 2022] PUT /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6/groups/48128f862dff4c7e8fca543fc607c3d1/roles/0cb8656b530647bea1bc161edf344c96 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:32.132083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78538a69-46d9-4357-93eb-8686b1700c34 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:32.141069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd149d58-4936-47b6-bb3d-4f26267a4a39 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:32.189991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598adda5-e968-4b32-96b3-10ab93021da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:32.190916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598adda5-e968-4b32-96b3-10ab93021da1 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.191405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598adda5-e968-4b32-96b3-10ab93021da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.192225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598adda5-e968-4b32-96b3-10ab93021da1 None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6/groups/48128f862dff4c7e8fca543fc607c3d1/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.195142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598adda5-e968-4b32-96b3-10ab93021da1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c21175d79504afbab1ea1c1297c36f6, group_id=48128f862dff4c7e8fca543fc607c3d1, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:32.197298 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598adda5-e968-4b32-96b3-10ab93021da1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:32.275417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 207/414] 10.222.0.55 () {58 vars in 1442 bytes} [Mon Jul 25 22:44:32 2022] PUT /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6/groups/48128f862dff4c7e8fca543fc607c3d1/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:32.281590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598adda5-e968-4b32-96b3-10ab93021da1 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:32.293685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78538a69-46d9-4357-93eb-8686b1700c34 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:32.297159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:32.350171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f943916-9ae2-4321-bfa4-9f44a25ce833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:32.350171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943916-9ae2-4321-bfa4-9f44a25ce833 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.350475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943916-9ae2-4321-bfa4-9f44a25ce833 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.350718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943916-9ae2-4321-bfa4-9f44a25ce833 None admin] PATH_INFO: `/v3/groups/c3c4cd6852154adb94cbac6d95401c84` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.353486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f943916-9ae2-4321-bfa4-9f44a25ce833 None admin] RBAC: Authorizing `identity:get_group(group_id=c3c4cd6852154adb94cbac6d95401c84)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:32.356820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f943916-9ae2-4321-bfa4-9f44a25ce833 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:32.360522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 208/415] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:32 2022] GET /identity/v3/groups/c3c4cd6852154adb94cbac6d95401c84 => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:32.369768 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f943916-9ae2-4321-bfa4-9f44a25ce833 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:32.411610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:32.434140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598adda5-e968-4b32-96b3-10ab93021da1 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:32.480793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf3fc6-8ce7-4144-85dd-008270f40f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:32.482348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf3fc6-8ce7-4144-85dd-008270f40f34 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.482842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf3fc6-8ce7-4144-85dd-008270f40f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.483531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf3fc6-8ce7-4144-85dd-008270f40f34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.497719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf3fc6-8ce7-4144-85dd-008270f40f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-ccaf3fc6-8ce7-4144-85dd-008270f40f34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:32.504644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:32.505902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:32.506655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:32.509294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 208/416] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:44:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:32.515253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf3fc6-8ce7-4144-85dd-008270f40f34 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:32.524890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f943916-9ae2-4321-bfa4-9f44a25ce833 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:32.572409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b76a6-a31c-48cc-ac79-4d56a9d9c77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:32.573619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b76a6-a31c-48cc-ac79-4d56a9d9c77c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.574043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b76a6-a31c-48cc-ac79-4d56a9d9c77c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.575399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b76a6-a31c-48cc-ac79-4d56a9d9c77c None admin] PATH_INFO: `/v3/projects/95854b83c1ee4dca86942110e1c80272` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.577041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b76a6-a31c-48cc-ac79-4d56a9d9c77c None admin] RBAC: Authorizing `identity:get_project(project_id=95854b83c1ee4dca86942110e1c80272)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:32.579354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b76a6-a31c-48cc-ac79-4d56a9d9c77c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:32.581524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 209/417] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:32 2022] GET /identity/v3/projects/95854b83c1ee4dca86942110e1c80272 => generated 344 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:32.588646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b76a6-a31c-48cc-ac79-4d56a9d9c77c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:32.640147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf3fc6-8ce7-4144-85dd-008270f40f34 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:32.658412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:32.685249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b12158-ae3d-4b44-8697-c48bf590c19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:32.686684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b12158-ae3d-4b44-8697-c48bf590c19a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.687452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b12158-ae3d-4b44-8697-c48bf590c19a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.688191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b12158-ae3d-4b44-8697-c48bf590c19a None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.689859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b12158-ae3d-4b44-8697-c48bf590c19a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:32.690684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b12158-ae3d-4b44-8697-c48bf590c19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:32.692890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b12158-ae3d-4b44-8697-c48bf590c19a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:32.705603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 209/418] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:32.713172 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b12158-ae3d-4b44-8697-c48bf590c19a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:32.718309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:32.749842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b76a6-a31c-48cc-ac79-4d56a9d9c77c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:32.798686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca804-4cc0-418b-99c1-3ee74eb7ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:32.799440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca804-4cc0-418b-99c1-3ee74eb7ab84 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.799726 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca804-4cc0-418b-99c1-3ee74eb7ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.800003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca804-4cc0-418b-99c1-3ee74eb7ab84 None admin] PATH_INFO: `/v3/projects/95854b83c1ee4dca86942110e1c80272/groups/c3c4cd6852154adb94cbac6d95401c84/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.803756 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eca804-4cc0-418b-99c1-3ee74eb7ab84 None admin] RBAC: Authorizing `identity:create_grant(project_id=95854b83c1ee4dca86942110e1c80272, group_id=c3c4cd6852154adb94cbac6d95401c84, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:32.805504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eca804-4cc0-418b-99c1-3ee74eb7ab84 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:32.877264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b12158-ae3d-4b44-8697-c48bf590c19a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:32.887959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 210/419] 10.222.0.55 () {58 vars in 1442 bytes} [Mon Jul 25 22:44:32 2022] PUT /identity/v3/projects/95854b83c1ee4dca86942110e1c80272/groups/c3c4cd6852154adb94cbac6d95401c84/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:32.889529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12afa0-822f-4ada-850d-4235d11cd64a None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.889912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12afa0-822f-4ada-850d-4235d11cd64a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.890281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12afa0-822f-4ada-850d-4235d11cd64a None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.892034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 211/420] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:32.899397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e24f-4c8b-43ce-8e9b-a9c2d12d6ac2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.899779 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e24f-4c8b-43ce-8e9b-a9c2d12d6ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.900135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e24f-4c8b-43ce-8e9b-a9c2d12d6ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.930807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac294db-65a8-4ff3-b1df-a09a0511d4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:32.932109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac294db-65a8-4ff3-b1df-a09a0511d4ea None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.932683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac294db-65a8-4ff3-b1df-a09a0511d4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.933430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac294db-65a8-4ff3-b1df-a09a0511d4ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.943467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7c75e24f-4c8b-43ce-8e9b-a9c2d12d6ac2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:32.944862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7c75e24f-4c8b-43ce-8e9b-a9c2d12d6ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:33.086903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac294db-65a8-4ff3-b1df-a09a0511d4ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:33.099585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac294db-65a8-4ff3-b1df-a09a0511d4ea None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:33.099585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:33.125966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 212/421] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:33.162107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75e24f-4c8b-43ce-8e9b-a9c2d12d6ac2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:33.223279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:33.356309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 210/422] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:33.362700 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75e24f-4c8b-43ce-8e9b-a9c2d12d6ac2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:33.371425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac294db-65a8-4ff3-b1df-a09a0511d4ea None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:33.425005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80db5-3e42-4b02-a9bc-df9f4c920bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:33.426368 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80db5-3e42-4b02-a9bc-df9f4c920bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:33.429143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80db5-3e42-4b02-a9bc-df9f4c920bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:33.429143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80db5-3e42-4b02-a9bc-df9f4c920bf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:33.443264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c80db5-3e42-4b02-a9bc-df9f4c920bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-12c80db5-3e42-4b02-a9bc-df9f4c920bf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:33.449080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:33.449998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:33.450780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 213/423] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:33.461463 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80db5-3e42-4b02-a9bc-df9f4c920bf9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:33.570038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac294db-65a8-4ff3-b1df-a09a0511d4ea None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:33.577139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:33.612525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdedcf4-7b98-4c5e-b8d9-239fcedd86ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:33.614136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdedcf4-7b98-4c5e-b8d9-239fcedd86ee None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:33.614621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdedcf4-7b98-4c5e-b8d9-239fcedd86ee None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:33.615118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdedcf4-7b98-4c5e-b8d9-239fcedd86ee None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:33.618471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:33.623859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdedcf4-7b98-4c5e-b8d9-239fcedd86ee None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:33.625513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdedcf4-7b98-4c5e-b8d9-239fcedd86ee None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:33.627753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 211/424] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:33 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:33.627938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80db5-3e42-4b02-a9bc-df9f4c920bf9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:33.634075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdedcf4-7b98-4c5e-b8d9-239fcedd86ee None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:33.667255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdef256-a9f7-4163-80d6-d08fea40238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:33.667997 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef256-a9f7-4163-80d6-d08fea40238e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:33.668283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef256-a9f7-4163-80d6-d08fea40238e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:33.668559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef256-a9f7-4163-80d6-d08fea40238e None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:33.669321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdef256-a9f7-4163-80d6-d08fea40238e None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:33.669629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdef256-a9f7-4163-80d6-d08fea40238e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:33.671356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdef256-a9f7-4163-80d6-d08fea40238e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:33.681782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 214/425] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:33.693722 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdef256-a9f7-4163-80d6-d08fea40238e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:33.782450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdedcf4-7b98-4c5e-b8d9-239fcedd86ee None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:33.824486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a63f-0bbe-4370-b3f2-7f3bb0f0f0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:33.825041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a63f-0bbe-4370-b3f2-7f3bb0f0f0ba None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:33.825342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a63f-0bbe-4370-b3f2-7f3bb0f0f0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:33.825619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a63f-0bbe-4370-b3f2-7f3bb0f0f0ba None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:33.826783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0a63f-0bbe-4370-b3f2-7f3bb0f0f0ba None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:33.828250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0a63f-0bbe-4370-b3f2-7f3bb0f0f0ba None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:33.830206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 212/426] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:33 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:33.836683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a63f-0bbe-4370-b3f2-7f3bb0f0f0ba None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:33.885483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:33.949289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdef256-a9f7-4163-80d6-d08fea40238e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:33.986136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07133b8c-570a-431d-8a19-85cf5f144bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:33.987149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07133b8c-570a-431d-8a19-85cf5f144bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:33.987575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07133b8c-570a-431d-8a19-85cf5f144bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:33.988002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07133b8c-570a-431d-8a19-85cf5f144bc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:34.012197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:34.015130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a63f-0bbe-4370-b3f2-7f3bb0f0f0ba None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:34.085149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07133b8c-570a-431d-8a19-85cf5f144bc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:34.086817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07133b8c-570a-431d-8a19-85cf5f144bc0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:34.090490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eaaf5-9189-4059-a5fa-d725afe64154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:34.091582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eaaf5-9189-4059-a5fa-d725afe64154 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:34.092071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eaaf5-9189-4059-a5fa-d725afe64154 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:34.092558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eaaf5-9189-4059-a5fa-d725afe64154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:34.094201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eaaf5-9189-4059-a5fa-d725afe64154 None admin] RBAC: Adding query filter params (group.id=48128f862dff4c7e8fca543fc607c3d1, role.id=0cb8656b530647bea1bc161edf344c96, scope.project.id=048254d114684a7e8e71048df03aaf23) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:34.094745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eaaf5-9189-4059-a5fa-d725afe64154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:34.104758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eaaf5-9189-4059-a5fa-d725afe64154 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:34.131419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 213/427] 10.222.0.55 () {56 vars in 1376 bytes} [Mon Jul 25 22:44:33 2022] GET /identity/v3/role_assignments?group.id=48128f862dff4c7e8fca543fc607c3d1&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=0cb8656b530647bea1bc161edf344c96 => generated 611 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:34.247772 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 215/428] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:34.254304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eaaf5-9189-4059-a5fa-d725afe64154 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:34.504690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eaaf5-9189-4059-a5fa-d725afe64154 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:34.507868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:34.574240 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cb290-e944-4924-9b59-855c6b6f4c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:34.575249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cb290-e944-4924-9b59-855c6b6f4c2a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:34.575722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cb290-e944-4924-9b59-855c6b6f4c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:34.576210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cb290-e944-4924-9b59-855c6b6f4c2a None admin] PATH_INFO: `/v3/projects/048254d114684a7e8e71048df03aaf23` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:34.581102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cb290-e944-4924-9b59-855c6b6f4c2a None admin] RBAC: Authorizing `identity:get_project(project_id=048254d114684a7e8e71048df03aaf23)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:34.584484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cb290-e944-4924-9b59-855c6b6f4c2a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:34.588130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 214/429] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:34 2022] GET /identity/v3/projects/048254d114684a7e8e71048df03aaf23 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:34.593435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07133b8c-570a-431d-8a19-85cf5f144bc0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:34.663593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:34.719277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07133b8c-570a-431d-8a19-85cf5f144bc0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:34.757239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5e53d-b7ac-4247-bf71-94dd5a86ae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:34.757834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5e53d-b7ac-4247-bf71-94dd5a86ae10 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:34.758117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5e53d-b7ac-4247-bf71-94dd5a86ae10 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:34.758393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5e53d-b7ac-4247-bf71-94dd5a86ae10 None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:34.759635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5e53d-b7ac-4247-bf71-94dd5a86ae10 None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:34.761110 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5e53d-b7ac-4247-bf71-94dd5a86ae10 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:34.763148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 216/430] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:34 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:34.768994 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cb290-e944-4924-9b59-855c6b6f4c2a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:34.827488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f35149-0dab-46c6-814f-c7503a3b83ed None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:34.827771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f35149-0dab-46c6-814f-c7503a3b83ed None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:34.828083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f35149-0dab-46c6-814f-c7503a3b83ed None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:34.829853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 217/431] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:44:34.838185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887b85e-f09b-49ea-9410-a368d6f94be7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:34.839171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887b85e-f09b-49ea-9410-a368d6f94be7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:34.839840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887b85e-f09b-49ea-9410-a368d6f94be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:34.874789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2887b85e-f09b-49ea-9410-a368d6f94be7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:34.876993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2887b85e-f09b-49ea-9410-a368d6f94be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:34.921935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cb290-e944-4924-9b59-855c6b6f4c2a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:34.970172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 218/432] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:34.977433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97338d60-7770-4211-82a0-39d1785f7584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:34.978394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97338d60-7770-4211-82a0-39d1785f7584 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:34.978905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97338d60-7770-4211-82a0-39d1785f7584 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:34.979381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97338d60-7770-4211-82a0-39d1785f7584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:34.980402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97338d60-7770-4211-82a0-39d1785f7584 None admin] RBAC: Adding query filter params (group.id=48128f862dff4c7e8fca543fc607c3d1, role.id=8458ab7384a043d2a03698163d3892fd, scope.project.id=048254d114684a7e8e71048df03aaf23) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:34.980930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97338d60-7770-4211-82a0-39d1785f7584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:34.982603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97338d60-7770-4211-82a0-39d1785f7584 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:34.990077 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 215/433] 10.222.0.55 () {56 vars in 1376 bytes} [Mon Jul 25 22:44:34 2022] GET /identity/v3/role_assignments?group.id=48128f862dff4c7e8fca543fc607c3d1&scope.project.id=048254d114684a7e8e71048df03aaf23&role.id=8458ab7384a043d2a03698163d3892fd => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:34.999813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887b85e-f09b-49ea-9410-a368d6f94be7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:35.068652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:35.121573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887b85e-f09b-49ea-9410-a368d6f94be7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:35.163820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a4b24-a5e3-4465-a8e4-88dde1c49b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:35.164508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a4b24-a5e3-4465-a8e4-88dde1c49b30 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.164798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a4b24-a5e3-4465-a8e4-88dde1c49b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.165100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a4b24-a5e3-4465-a8e4-88dde1c49b30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.177865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a4b24-a5e3-4465-a8e4-88dde1c49b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-0a8a4b24-a5e3-4465-a8e4-88dde1c49b30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:35.183014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:35.183948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:35.184802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 219/434] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:35.191017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97338d60-7770-4211-82a0-39d1785f7584 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:35.197591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d341f-d7ac-4255-af2e-ac462b843b73 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.198093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d341f-d7ac-4255-af2e-ac462b843b73 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.198588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d341f-d7ac-4255-af2e-ac462b843b73 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.201416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 220/435] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:35.211182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ce1f5-a5c5-497c-be90-058a48997978 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.211665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ce1f5-a5c5-497c-be90-058a48997978 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.212147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ce1f5-a5c5-497c-be90-058a48997978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.237877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:35.243211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d50ce1f5-a5c5-497c-be90-058a48997978 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:35.244955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d50ce1f5-a5c5-497c-be90-058a48997978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:35.346624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97338d60-7770-4211-82a0-39d1785f7584 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:35.378442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 221/436] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:35.404661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39ea64-f1f1-49c9-b512-bacd7bb80714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:35.405349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39ea64-f1f1-49c9-b512-bacd7bb80714 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.405633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39ea64-f1f1-49c9-b512-bacd7bb80714 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.405909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39ea64-f1f1-49c9-b512-bacd7bb80714 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.406649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39ea64-f1f1-49c9-b512-bacd7bb80714 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:35.407000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39ea64-f1f1-49c9-b512-bacd7bb80714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:35.408371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39ea64-f1f1-49c9-b512-bacd7bb80714 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:35.412872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ce1f5-a5c5-497c-be90-058a48997978 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:35.430157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 216/437] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:44:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:35.436060 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39ea64-f1f1-49c9-b512-bacd7bb80714 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:35.506066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:35.586822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ce1f5-a5c5-497c-be90-058a48997978 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:35.612099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:35.617055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39ea64-f1f1-49c9-b512-bacd7bb80714 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:35.649436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7056df6-c2b3-4eb3-b9bc-ff5239b88663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:35.650431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7056df6-c2b3-4eb3-b9bc-ff5239b88663 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.650875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7056df6-c2b3-4eb3-b9bc-ff5239b88663 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.651323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7056df6-c2b3-4eb3-b9bc-ff5239b88663 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.664537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7056df6-c2b3-4eb3-b9bc-ff5239b88663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b7056df6-c2b3-4eb3-b9bc-ff5239b88663 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:35.672626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:35.673612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:35.674395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 222/438] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:44:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:35.678843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29be1df-f0a1-4655-99fa-b47ac8d7f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:35.679303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7056df6-c2b3-4eb3-b9bc-ff5239b88663 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:35.680464 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29be1df-f0a1-4655-99fa-b47ac8d7f329 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.680904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29be1df-f0a1-4655-99fa-b47ac8d7f329 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.682878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29be1df-f0a1-4655-99fa-b47ac8d7f329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.783772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29be1df-f0a1-4655-99fa-b47ac8d7f329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:35.786400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29be1df-f0a1-4655-99fa-b47ac8d7f329 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:35.847005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7056df6-c2b3-4eb3-b9bc-ff5239b88663 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:35.850279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:35.893767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc5468-c8e5-4f7c-9d59-6d6cf5fbda29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:35.895349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc5468-c8e5-4f7c-9d59-6d6cf5fbda29 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.895769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc5468-c8e5-4f7c-9d59-6d6cf5fbda29 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.896256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc5468-c8e5-4f7c-9d59-6d6cf5fbda29 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.896785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc5468-c8e5-4f7c-9d59-6d6cf5fbda29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:35.897285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc5468-c8e5-4f7c-9d59-6d6cf5fbda29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:35.899126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc5468-c8e5-4f7c-9d59-6d6cf5fbda29 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:35.907840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 223/439] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:35.914501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc5468-c8e5-4f7c-9d59-6d6cf5fbda29 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:35.958425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:35.969477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 217/440] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:44:35.973451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d1ae-c0ef-4b38-a665-dab4aacb99ae None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.973451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d1ae-c0ef-4b38-a665-dab4aacb99ae None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.973451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d1ae-c0ef-4b38-a665-dab4aacb99ae None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.973451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 218/441] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:35.974307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073d1ae-c0ef-4b38-a665-dab4aacb99ae None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:36.032961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc5468-c8e5-4f7c-9d59-6d6cf5fbda29 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:36.071091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cee70-977e-4679-b0b4-cf2c01fc6e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:36.071710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cee70-977e-4679-b0b4-cf2c01fc6e33 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:36.071988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cee70-977e-4679-b0b4-cf2c01fc6e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:36.072261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cee70-977e-4679-b0b4-cf2c01fc6e33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:36.107880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:36.115561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073d1ae-c0ef-4b38-a665-dab4aacb99ae None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:36.153388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5cd76-6691-40b7-8d93-af30844df34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:36.153915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cd76-6691-40b7-8d93-af30844df34e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:36.154192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cd76-6691-40b7-8d93-af30844df34e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:36.154466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cd76-6691-40b7-8d93-af30844df34e None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:36.155655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5cd76-6691-40b7-8d93-af30844df34e None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:36.157160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5cd76-6691-40b7-8d93-af30844df34e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:36.158845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 219/442] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:35 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:36.160494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c53e58-40b5-45a6-96ac-0d5c462fb013 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:36.160846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c53e58-40b5-45a6-96ac-0d5c462fb013 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:36.161340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c53e58-40b5-45a6-96ac-0d5c462fb013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:36.165767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cee70-977e-4679-b0b4-cf2c01fc6e33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:36.167275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cee70-977e-4679-b0b4-cf2c01fc6e33 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:36.181451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b1c53e58-40b5-45a6-96ac-0d5c462fb013 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:36.182684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b1c53e58-40b5-45a6-96ac-0d5c462fb013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:36.259771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:36.273189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 220/443] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:36.273189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c53e58-40b5-45a6-96ac-0d5c462fb013 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:36.292956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 224/444] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:44:36.298316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cee70-977e-4679-b0b4-cf2c01fc6e33 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:36.366074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:36.394033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c53e58-40b5-45a6-96ac-0d5c462fb013 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:36.409104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cee70-977e-4679-b0b4-cf2c01fc6e33 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:36.431847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef311098-1411-4504-81aa-77222764805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:36.432493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef311098-1411-4504-81aa-77222764805f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:36.432784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef311098-1411-4504-81aa-77222764805f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:36.433064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef311098-1411-4504-81aa-77222764805f None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:36.434266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef311098-1411-4504-81aa-77222764805f None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:36.435728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef311098-1411-4504-81aa-77222764805f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:36.437423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 221/445] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:36 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:36.438212 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef311098-1411-4504-81aa-77222764805f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:36.457436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999db13-302f-483e-a364-8defabb85add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:36.458603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999db13-302f-483e-a364-8defabb85add None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:36.459061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999db13-302f-483e-a364-8defabb85add None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:36.459532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999db13-302f-483e-a364-8defabb85add None admin] PATH_INFO: `/v3/projects/5c21175d79504afbab1ea1c1297c36f6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:36.461755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999db13-302f-483e-a364-8defabb85add None admin] RBAC: Authorizing `identity:get_project(project_id=5c21175d79504afbab1ea1c1297c36f6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:36.464406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999db13-302f-483e-a364-8defabb85add None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:36.473472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 225/446] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:36 2022] GET /identity/v3/projects/5c21175d79504afbab1ea1c1297c36f6 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:36.473472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999db13-302f-483e-a364-8defabb85add None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:36.518654 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:36.571025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef311098-1411-4504-81aa-77222764805f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:36.605397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999db13-302f-483e-a364-8defabb85add None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:36.622739 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c55cbc-e6a1-46ea-8c13-64b51e8f8683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:36.623727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c55cbc-e6a1-46ea-8c13-64b51e8f8683 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:36.624113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c55cbc-e6a1-46ea-8c13-64b51e8f8683 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:36.624567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c55cbc-e6a1-46ea-8c13-64b51e8f8683 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:36.640861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c55cbc-e6a1-46ea-8c13-64b51e8f8683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:36.642877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f0c55cbc-e6a1-46ea-8c13-64b51e8f8683 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:36.648189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:36.650179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 222/447] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:36.652046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c55cbc-e6a1-46ea-8c13-64b51e8f8683 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:36.658398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e98f9-5f52-4026-a8d0-87053c7d09e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:36.658398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e98f9-5f52-4026-a8d0-87053c7d09e0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:36.658398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e98f9-5f52-4026-a8d0-87053c7d09e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:36.658781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e98f9-5f52-4026-a8d0-87053c7d09e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:36.660843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e98f9-5f52-4026-a8d0-87053c7d09e0 None admin] RBAC: Adding query filter params (group.id=48128f862dff4c7e8fca543fc607c3d1, role.id=8458ab7384a043d2a03698163d3892fd, scope.project.id=5c21175d79504afbab1ea1c1297c36f6) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:36.661102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e98f9-5f52-4026-a8d0-87053c7d09e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:36.663087 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e98f9-5f52-4026-a8d0-87053c7d09e0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:36.670284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 226/448] 10.222.0.55 () {56 vars in 1376 bytes} [Mon Jul 25 22:44:36 2022] GET /identity/v3/role_assignments?group.id=48128f862dff4c7e8fca543fc607c3d1&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=8458ab7384a043d2a03698163d3892fd => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:36.671698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e98f9-5f52-4026-a8d0-87053c7d09e0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:36.852522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e98f9-5f52-4026-a8d0-87053c7d09e0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:36.864560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c55cbc-e6a1-46ea-8c13-64b51e8f8683 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:36.903979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:36.908117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae030eb-19f4-402d-a91b-79dd8029e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:36.908794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae030eb-19f4-402d-a91b-79dd8029e6ef None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:36.909112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae030eb-19f4-402d-a91b-79dd8029e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:36.909456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae030eb-19f4-402d-a91b-79dd8029e6ef None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:36.910783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae030eb-19f4-402d-a91b-79dd8029e6ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:36.911204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae030eb-19f4-402d-a91b-79dd8029e6ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:36.912815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae030eb-19f4-402d-a91b-79dd8029e6ef None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:36.922803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 227/449] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:36.930530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de576516-a817-4762-996c-71b7d9ccfe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:36.931659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576516-a817-4762-996c-71b7d9ccfe9d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:36.932157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576516-a817-4762-996c-71b7d9ccfe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:36.932330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae030eb-19f4-402d-a91b-79dd8029e6ef None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:36.932649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576516-a817-4762-996c-71b7d9ccfe9d None admin] PATH_INFO: `/v3/groups/48128f862dff4c7e8fca543fc607c3d1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:36.934860 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de576516-a817-4762-996c-71b7d9ccfe9d None admin] RBAC: Authorizing `identity:get_group(group_id=48128f862dff4c7e8fca543fc607c3d1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:36.937771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de576516-a817-4762-996c-71b7d9ccfe9d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:36.942074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 223/450] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:36 2022] GET /identity/v3/groups/48128f862dff4c7e8fca543fc607c3d1 => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:36.953804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de576516-a817-4762-996c-71b7d9ccfe9d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:37.032311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:37.116299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae030eb-19f4-402d-a91b-79dd8029e6ef None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:37.154877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de576516-a817-4762-996c-71b7d9ccfe9d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:37.184354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addb72a-a781-49d3-b4af-161bf47875b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:37.185312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addb72a-a781-49d3-b4af-161bf47875b6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:37.185780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addb72a-a781-49d3-b4af-161bf47875b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:37.186232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addb72a-a781-49d3-b4af-161bf47875b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:37.220323 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd5e1-cdf6-4874-9486-b6fb8805b444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:37.221339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd5e1-cdf6-4874-9486-b6fb8805b444 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:37.221795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd5e1-cdf6-4874-9486-b6fb8805b444 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:37.222319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd5e1-cdf6-4874-9486-b6fb8805b444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:37.224688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edd5e1-cdf6-4874-9486-b6fb8805b444 None admin] RBAC: Adding query filter params (group.id=48128f862dff4c7e8fca543fc607c3d1, role.id=0cb8656b530647bea1bc161edf344c96, scope.project.id=5c21175d79504afbab1ea1c1297c36f6) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:37.225241 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edd5e1-cdf6-4874-9486-b6fb8805b444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:37.227736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edd5e1-cdf6-4874-9486-b6fb8805b444 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:37.238707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 224/451] 10.222.0.55 () {56 vars in 1376 bytes} [Mon Jul 25 22:44:36 2022] GET /identity/v3/role_assignments?group.id=48128f862dff4c7e8fca543fc607c3d1&scope.project.id=5c21175d79504afbab1ea1c1297c36f6&role.id=0cb8656b530647bea1bc161edf344c96 => generated 611 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:37.299802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addb72a-a781-49d3-b4af-161bf47875b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:37.302574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addb72a-a781-49d3-b4af-161bf47875b6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:37.384408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:37.445862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 228/452] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:37.452005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd5e1-cdf6-4874-9486-b6fb8805b444 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:37.536641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:37.605409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd5e1-cdf6-4874-9486-b6fb8805b444 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:37.651912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c96fce-fc52-4312-b636-651dac7dd16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:37.652581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c96fce-fc52-4312-b636-651dac7dd16c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:37.652859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c96fce-fc52-4312-b636-651dac7dd16c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:37.653161 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c96fce-fc52-4312-b636-651dac7dd16c None admin] PATH_INFO: `/v3/projects/95854b83c1ee4dca86942110e1c80272` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:37.654412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c96fce-fc52-4312-b636-651dac7dd16c None admin] RBAC: Authorizing `identity:get_project(project_id=95854b83c1ee4dca86942110e1c80272)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:37.655908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c96fce-fc52-4312-b636-651dac7dd16c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:37.657657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 225/453] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:44:37 2022] GET /identity/v3/projects/95854b83c1ee4dca86942110e1c80272 => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:37.664073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addb72a-a781-49d3-b4af-161bf47875b6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:37.766602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addb72a-a781-49d3-b4af-161bf47875b6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:37.802594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ed020-cf78-420d-9d0f-ba7be4adc7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:37.803243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ed020-cf78-420d-9d0f-ba7be4adc7cb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:37.803530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ed020-cf78-420d-9d0f-ba7be4adc7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:37.803810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ed020-cf78-420d-9d0f-ba7be4adc7cb None admin] PATH_INFO: `/v3/groups/c3c4cd6852154adb94cbac6d95401c84` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:37.805028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ed020-cf78-420d-9d0f-ba7be4adc7cb None admin] RBAC: Authorizing `identity:get_group(group_id=c3c4cd6852154adb94cbac6d95401c84)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:37.806534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ed020-cf78-420d-9d0f-ba7be4adc7cb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:37.808179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 229/454] 10.222.0.55 () {56 vars in 1180 bytes} [Mon Jul 25 22:44:37 2022] GET /identity/v3/groups/c3c4cd6852154adb94cbac6d95401c84 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:37.814363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c96fce-fc52-4312-b636-651dac7dd16c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:37.923166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c96fce-fc52-4312-b636-651dac7dd16c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:37.946947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:37.959146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb6a02-0ab4-48db-bc25-69aeeb74eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:37.959774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6a02-0ab4-48db-bc25-69aeeb74eb57 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:37.960060 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6a02-0ab4-48db-bc25-69aeeb74eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:37.960335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6a02-0ab4-48db-bc25-69aeeb74eb57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:37.961142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6a02-0ab4-48db-bc25-69aeeb74eb57 None admin] RBAC: Adding query filter params (group.id=c3c4cd6852154adb94cbac6d95401c84, role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=95854b83c1ee4dca86942110e1c80272) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:37.961492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6a02-0ab4-48db-bc25-69aeeb74eb57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:37.970546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6a02-0ab4-48db-bc25-69aeeb74eb57 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:37.970546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 226/455] 10.222.0.55 () {56 vars in 1376 bytes} [Mon Jul 25 22:44:37 2022] GET /identity/v3/role_assignments?group.id=c3c4cd6852154adb94cbac6d95401c84&scope.project.id=95854b83c1ee4dca86942110e1c80272&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:41.363990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c32818-41e5-4190-8dac-44f751489f6c None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:41.364908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c32818-41e5-4190-8dac-44f751489f6c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:41.365031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c32818-41e5-4190-8dac-44f751489f6c None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:41.367943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 230/456] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:41.395294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316788b-1ca6-4a86-971d-80f244e16e68 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:41.396084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316788b-1ca6-4a86-971d-80f244e16e68 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:41.396084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316788b-1ca6-4a86-971d-80f244e16e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:41.422800 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f316788b-1ca6-4a86-971d-80f244e16e68 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:41.424014 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f316788b-1ca6-4a86-971d-80f244e16e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:41.549231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 227/457] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:41.625518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c32818-41e5-4190-8dac-44f751489f6c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:41.688088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:41.899163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c32818-41e5-4190-8dac-44f751489f6c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:41.947248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5ce04-b24c-4bd7-a593-53a2b8b25a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:41.947912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5ce04-b24c-4bd7-a593-53a2b8b25a1c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:41.948185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5ce04-b24c-4bd7-a593-53a2b8b25a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:41.948464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5ce04-b24c-4bd7-a593-53a2b8b25a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:41.964649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5ce04-b24c-4bd7-a593-53a2b8b25a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:41.966218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5ce04-b24c-4bd7-a593-53a2b8b25a1c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-8af5ce04-b24c-4bd7-a593-53a2b8b25a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:41.992636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:41.996042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:41.999884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:41.999884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:41.999884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:41.999884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:41.999884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 231/458] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:42.004406 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316788b-1ca6-4a86-971d-80f244e16e68 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:42.080312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98788a9-beb5-4ddc-869e-833c3320ffe8 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.080821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98788a9-beb5-4ddc-869e-833c3320ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.081340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98788a9-beb5-4ddc-869e-833c3320ffe8 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.088440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 232/459] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:42.089935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f20e2-8851-435b-b143-95540c59c7a3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.090220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f20e2-8851-435b-b143-95540c59c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.090487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f20e2-8851-435b-b143-95540c59c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.134909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a38f20e2-8851-435b-b143-95540c59c7a3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:42.136984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a38f20e2-8851-435b-b143-95540c59c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:42.243024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 233/460] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 25 22:44:42.244784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf8ee7-be40-4b7e-b6db-3f5e8432be34 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.245076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf8ee7-be40-4b7e-b6db-3f5e8432be34 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.245396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf8ee7-be40-4b7e-b6db-3f5e8432be34 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.249847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316788b-1ca6-4a86-971d-80f244e16e68 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:42.251399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 234/461] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:42.252758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c18e8-a0b2-4650-8dbf-7f881579ec7e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.253049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c18e8-a0b2-4650-8dbf-7f881579ec7e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.253365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c18e8-a0b2-4650-8dbf-7f881579ec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.268396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:42.276835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7e0c18e8-a0b2-4650-8dbf-7f881579ec7e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:42.278087 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7e0c18e8-a0b2-4650-8dbf-7f881579ec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:42.285464 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:42.315744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db330e-e3c7-4c36-9b60-991d9790429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:42.316396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db330e-e3c7-4c36-9b60-991d9790429c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.316680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db330e-e3c7-4c36-9b60-991d9790429c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.316993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db330e-e3c7-4c36-9b60-991d9790429c None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.317926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db330e-e3c7-4c36-9b60-991d9790429c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:42.318360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db330e-e3c7-4c36-9b60-991d9790429c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:42.323996 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db330e-e3c7-4c36-9b60-991d9790429c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:42.334709 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 228/462] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:42.335717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db330e-e3c7-4c36-9b60-991d9790429c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:42.415651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 235/463] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:42.418269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c18e8-a0b2-4650-8dbf-7f881579ec7e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:42.475847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db330e-e3c7-4c36-9b60-991d9790429c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:42.510096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbbf1c-0f42-42c2-9db8-2d0fe82f4ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:42.510664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbbf1c-0f42-42c2-9db8-2d0fe82f4ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.511009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbbf1c-0f42-42c2-9db8-2d0fe82f4ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.511344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbbf1c-0f42-42c2-9db8-2d0fe82f4ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.524628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbbf1c-0f42-42c2-9db8-2d0fe82f4ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:42.526207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbbf1c-0f42-42c2-9db8-2d0fe82f4ee1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f4fbbf1c-0f42-42c2-9db8-2d0fe82f4ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:42.543509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:42.545363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:42.547084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:42.547084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:42.547084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:42.547084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:42.547084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 229/464] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:42.547084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbbf1c-0f42-42c2-9db8-2d0fe82f4ee1 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:42.579704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:42.673029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbbf1c-0f42-42c2-9db8-2d0fe82f4ee1 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:42.691022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c18e8-a0b2-4650-8dbf-7f881579ec7e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:42.727136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f32f-797f-4161-af3b-5d51f5288edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:42.728470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f32f-797f-4161-af3b-5d51f5288edd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.728980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f32f-797f-4161-af3b-5d51f5288edd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.729536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f32f-797f-4161-af3b-5d51f5288edd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.751127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826f32f-797f-4161-af3b-5d51f5288edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:42.754591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826f32f-797f-4161-af3b-5d51f5288edd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:42.763025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0929b2-ad8b-489d-9e17-5d93483284af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:42.763576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0929b2-ad8b-489d-9e17-5d93483284af None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.763859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0929b2-ad8b-489d-9e17-5d93483284af None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.764137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0929b2-ad8b-489d-9e17-5d93483284af None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.764847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0929b2-ad8b-489d-9e17-5d93483284af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:42.766402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0929b2-ad8b-489d-9e17-5d93483284af None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:42.782031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7826f32f-797f-4161-af3b-5d51f5288edd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:42.784047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:42.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:42.786544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:42.786544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:42.786544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:42.786544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:42.787356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 230/465] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:42.788892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f32f-797f-4161-af3b-5d51f5288edd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:42.886656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 236/466] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:44:42 2022] POST /identity/v3/users => generated 248 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:44:42.887932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63a63-709d-4ec5-b818-c66df70de9bd None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.888278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63a63-709d-4ec5-b818-c66df70de9bd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.888498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63a63-709d-4ec5-b818-c66df70de9bd None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.893238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 237/467] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:42.893238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b63a63-709d-4ec5-b818-c66df70de9bd None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:42.899762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:42.932273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f32f-797f-4161-af3b-5d51f5288edd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:42.982992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa954d1-adbd-40fb-9f1d-def56b6c0fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:42.983645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa954d1-adbd-40fb-9f1d-def56b6c0fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.983929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa954d1-adbd-40fb-9f1d-def56b6c0fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.984213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa954d1-adbd-40fb-9f1d-def56b6c0fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.984945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa954d1-adbd-40fb-9f1d-def56b6c0fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:42.985296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa954d1-adbd-40fb-9f1d-def56b6c0fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:42.986812 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa954d1-adbd-40fb-9f1d-def56b6c0fb2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:43.010629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 231/468] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:43.010629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914e459-8941-4e7b-b734-0dd4cec69a24 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.010629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914e459-8941-4e7b-b734-0dd4cec69a24 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.010629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914e459-8941-4e7b-b734-0dd4cec69a24 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.010629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 232/469] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:43.010629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65b11-d613-473b-85ca-e20136d22fbe None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.010629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65b11-d613-473b-85ca-e20136d22fbe None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.011530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65b11-d613-473b-85ca-e20136d22fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.034126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-18e65b11-d613-473b-85ca-e20136d22fbe None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:43.035854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-18e65b11-d613-473b-85ca-e20136d22fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:43.053299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b63a63-709d-4ec5-b818-c66df70de9bd None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:43.103561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940213-17c2-4b32-a7cc-fc09bdfd5b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:43.104457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940213-17c2-4b32-a7cc-fc09bdfd5b24 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.104905 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940213-17c2-4b32-a7cc-fc09bdfd5b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.105548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940213-17c2-4b32-a7cc-fc09bdfd5b24 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.107265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09940213-17c2-4b32-a7cc-fc09bdfd5b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:43.107642 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09940213-17c2-4b32-a7cc-fc09bdfd5b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:43.110346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09940213-17c2-4b32-a7cc-fc09bdfd5b24 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:43.127153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 238/470] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:43.129169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940213-17c2-4b32-a7cc-fc09bdfd5b24 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:43.158747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 233/471] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:43.161343 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76824f91-970f-4125-ba94-b396e97bcee3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.161893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76824f91-970f-4125-ba94-b396e97bcee3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.162315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76824f91-970f-4125-ba94-b396e97bcee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.188430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-76824f91-970f-4125-ba94-b396e97bcee3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:43.189981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-76824f91-970f-4125-ba94-b396e97bcee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:43.223598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:43.288844 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:43.293836 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 234/472] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:43.295144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76824f91-970f-4125-ba94-b396e97bcee3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:43.307090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940213-17c2-4b32-a7cc-fc09bdfd5b24 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:43.353412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c252754-28f4-4600-a9cb-d3bc22bf8ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:43.354280 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c252754-28f4-4600-a9cb-d3bc22bf8ce7 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.354970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c252754-28f4-4600-a9cb-d3bc22bf8ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.355527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c252754-28f4-4600-a9cb-d3bc22bf8ce7 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.356741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c252754-28f4-4600-a9cb-d3bc22bf8ce7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:43.358734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c252754-28f4-4600-a9cb-d3bc22bf8ce7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:43.489153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 239/473] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:44:43 2022] POST /identity/v3/users => generated 246 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:44:43.489153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c252754-28f4-4600-a9cb-d3bc22bf8ce7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:43.494053 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76824f91-970f-4125-ba94-b396e97bcee3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:43.567380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa5f31-3655-40b8-989f-2d7858c0bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:43.568045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa5f31-3655-40b8-989f-2d7858c0bf5f None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.568396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa5f31-3655-40b8-989f-2d7858c0bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.568877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa5f31-3655-40b8-989f-2d7858c0bf5f None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.570304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa5f31-3655-40b8-989f-2d7858c0bf5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:43.572657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa5f31-3655-40b8-989f-2d7858c0bf5f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:43.694612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 235/474] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:44:43 2022] POST /identity/v3/users => generated 248 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:44:43.697074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa5f31-3655-40b8-989f-2d7858c0bf5f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:43.707394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c252754-28f4-4600-a9cb-d3bc22bf8ce7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:43.722082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:43.763219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63777b5f-53fe-4c66-b733-6abd339d6dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:43.764593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63777b5f-53fe-4c66-b733-6abd339d6dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.765080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63777b5f-53fe-4c66-b733-6abd339d6dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.765599 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63777b5f-53fe-4c66-b733-6abd339d6dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.782195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63777b5f-53fe-4c66-b733-6abd339d6dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:43.784663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63777b5f-53fe-4c66-b733-6abd339d6dc2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-63777b5f-53fe-4c66-b733-6abd339d6dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:43.810939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:43.813851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:43.815935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:43.815935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:43.815935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:43.815935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:43.815935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 240/475] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:43.829182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63777b5f-53fe-4c66-b733-6abd339d6dc2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:43.850370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:43.932858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa5f31-3655-40b8-989f-2d7858c0bf5f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:44.002524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cacc7-b7b0-41cc-854e-3d977e2bf5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:44.004252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cacc7-b7b0-41cc-854e-3d977e2bf5fc None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:44.005041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cacc7-b7b0-41cc-854e-3d977e2bf5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:44.005560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cacc7-b7b0-41cc-854e-3d977e2bf5fc None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:44.006534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cacc7-b7b0-41cc-854e-3d977e2bf5fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:44.008483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cacc7-b7b0-41cc-854e-3d977e2bf5fc None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:44.044155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63777b5f-53fe-4c66-b733-6abd339d6dc2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:44.058016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.sql.core [None req-139cacc7-b7b0-41cc-854e-3d977e2bf5fc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 22:44:44.058016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 22:44:44.058016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [parameters: {'id': '2e45ea3b2c4e4ad48a86fc91495fccee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 22:44:44.058016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80371) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-139cacc7-b7b0-41cc-854e-3d977e2bf5fc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result.read() Jul 25 22:44:44.082577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:44:44.083591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application yield resource Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise self.value Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application session.commit() Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:44:44.084777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:44:44.085900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:44:44.087078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result.read() Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:44:44.087986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [parameters: {'id': '2e45ea3b2c4e4ad48a86fc91495fccee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:44.088952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 22:44:44.089949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:44.092885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 236/476] 10.222.0.55 () {60 vars in 1131 bytes} [Mon Jul 25 22:44:43 2022] POST /identity/v3/roles => generated 144 bytes in 397 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:44.102291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cacc7-b7b0-41cc-854e-3d977e2bf5fc None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:44.102694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412e9a9-7d34-489f-8e97-6228c5e6fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:44.103613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412e9a9-7d34-489f-8e97-6228c5e6fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:44.104086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412e9a9-7d34-489f-8e97-6228c5e6fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:44.104854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412e9a9-7d34-489f-8e97-6228c5e6fbe2 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:44.106544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412e9a9-7d34-489f-8e97-6228c5e6fbe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:44.107261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412e9a9-7d34-489f-8e97-6228c5e6fbe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:44.109251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412e9a9-7d34-489f-8e97-6228c5e6fbe2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:44.127073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 241/477] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:44.143124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412e9a9-7d34-489f-8e97-6228c5e6fbe2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:44.177345 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:44.282272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cacc7-b7b0-41cc-854e-3d977e2bf5fc None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:44.314792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:44.330870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0120a-cef8-4f6c-9dfd-d4a89207105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:44.331718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0120a-cef8-4f6c-9dfd-d4a89207105e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:44.332236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0120a-cef8-4f6c-9dfd-d4a89207105e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:44.332876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0120a-cef8-4f6c-9dfd-d4a89207105e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:44.351121 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412e9a9-7d34-489f-8e97-6228c5e6fbe2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:44.367328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0120a-cef8-4f6c-9dfd-d4a89207105e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-c1e0120a-cef8-4f6c-9dfd-d4a89207105e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:44.377471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:44.383568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:44.385308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 237/478] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:44:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:44.391409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0120a-cef8-4f6c-9dfd-d4a89207105e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:44.436989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f363eb-972c-4621-8bda-25bfb14467af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:44.437758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f363eb-972c-4621-8bda-25bfb14467af None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:44.438043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f363eb-972c-4621-8bda-25bfb14467af None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:44.438321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f363eb-972c-4621-8bda-25bfb14467af None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:44.439046 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f363eb-972c-4621-8bda-25bfb14467af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:44.440601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f363eb-972c-4621-8bda-25bfb14467af None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:44.545728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 242/479] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:44:44 2022] POST /identity/v3/users => generated 249 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:44:44.622686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0120a-cef8-4f6c-9dfd-d4a89207105e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:44.707182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30765c8-34d5-4480-9323-441c4f6a3af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:44.708269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30765c8-34d5-4480-9323-441c4f6a3af2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:44.708767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30765c8-34d5-4480-9323-441c4f6a3af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:44.709327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30765c8-34d5-4480-9323-441c4f6a3af2 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:44.710613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30765c8-34d5-4480-9323-441c4f6a3af2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:44.711147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30765c8-34d5-4480-9323-441c4f6a3af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:44.715046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30765c8-34d5-4480-9323-441c4f6a3af2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:44.731943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 238/480] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:46.271716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484175c-3633-40bd-9ecc-d188fd412bb1 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:46.272491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484175c-3633-40bd-9ecc-d188fd412bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:46.272491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484175c-3633-40bd-9ecc-d188fd412bb1 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:46.273825 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 243/481] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:46.281451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f976a2-1299-4cf6-94b2-71d827509529 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:46.282255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f976a2-1299-4cf6-94b2-71d827509529 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:46.282255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f976a2-1299-4cf6-94b2-71d827509529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:46.307470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-85f976a2-1299-4cf6-94b2-71d827509529 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:46.308693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-85f976a2-1299-4cf6-94b2-71d827509529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:46.361688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:46.432517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 239/482] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:46.472955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484175c-3633-40bd-9ecc-d188fd412bb1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:46.591430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:46.621162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484175c-3633-40bd-9ecc-d188fd412bb1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:46.683503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec5a88-58ca-4dc0-9a31-dcfcfb1b010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:46.685025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec5a88-58ca-4dc0-9a31-dcfcfb1b010e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:46.685769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec5a88-58ca-4dc0-9a31-dcfcfb1b010e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:46.686462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec5a88-58ca-4dc0-9a31-dcfcfb1b010e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:46.718523 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec5a88-58ca-4dc0-9a31-dcfcfb1b010e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a4ec5a88-58ca-4dc0-9a31-dcfcfb1b010e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:46.730986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:46.732677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:46.738736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:46.742324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 244/483] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:46.749380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f976a2-1299-4cf6-94b2-71d827509529 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:46.980104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f976a2-1299-4cf6-94b2-71d827509529 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:47.059821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf10d2f-431c-45b3-9978-2967b27aa249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:47.060449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf10d2f-431c-45b3-9978-2967b27aa249 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.060730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf10d2f-431c-45b3-9978-2967b27aa249 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.061005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf10d2f-431c-45b3-9978-2967b27aa249 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.061760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf10d2f-431c-45b3-9978-2967b27aa249 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:47.062066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf10d2f-431c-45b3-9978-2967b27aa249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:47.063455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf10d2f-431c-45b3-9978-2967b27aa249 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:47.077151 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 240/484] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:44:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:47.083867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec5a88-58ca-4dc0-9a31-dcfcfb1b010e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:47.093402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e3016-2cb4-49c5-b04f-3102de02c4fa None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.093687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e3016-2cb4-49c5-b04f-3102de02c4fa None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.103206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e3016-2cb4-49c5-b04f-3102de02c4fa None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.103206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 241/485] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:44:47.103206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d531d-463f-4936-8819-cb95133e1b33 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.103206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d531d-463f-4936-8819-cb95133e1b33 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.103206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d531d-463f-4936-8819-cb95133e1b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.132500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-520d531d-463f-4936-8819-cb95133e1b33 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:47.132500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-520d531d-463f-4936-8819-cb95133e1b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:47.180407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:47.264214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 242/486] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:44:47.285545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec5a88-58ca-4dc0-9a31-dcfcfb1b010e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:47.317217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d531d-463f-4936-8819-cb95133e1b33 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:47.344088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c7606-e0bd-45d9-a67c-060690c2f9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:47.345209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c7606-e0bd-45d9-a67c-060690c2f9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.345695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c7606-e0bd-45d9-a67c-060690c2f9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.347786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c7606-e0bd-45d9-a67c-060690c2f9f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.359687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c7606-e0bd-45d9-a67c-060690c2f9f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:47.361685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c7606-e0bd-45d9-a67c-060690c2f9f9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:47.370242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-c63c7606-e0bd-45d9-a67c-060690c2f9f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:47.379233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:47.380103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:47.381407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:47.381407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:47.381407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:47.381407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:47.383144 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 245/487] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:47.384220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5264672-32f0-4be0-8b02-13fa6ca07fcc None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.384535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5264672-32f0-4be0-8b02-13fa6ca07fcc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.384771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5264672-32f0-4be0-8b02-13fa6ca07fcc None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.387823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 246/488] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:47.388983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5264672-32f0-4be0-8b02-13fa6ca07fcc None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:47.520596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5264672-32f0-4be0-8b02-13fa6ca07fcc None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:47.527562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d531d-463f-4936-8819-cb95133e1b33 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:47.564270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca27dad-06e9-48f6-adeb-2d74a1b92612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:47.564891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca27dad-06e9-48f6-adeb-2d74a1b92612 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.565264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca27dad-06e9-48f6-adeb-2d74a1b92612 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.565536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca27dad-06e9-48f6-adeb-2d74a1b92612 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.566346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca27dad-06e9-48f6-adeb-2d74a1b92612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:47.566658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca27dad-06e9-48f6-adeb-2d74a1b92612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:47.568064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca27dad-06e9-48f6-adeb-2d74a1b92612 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:47.568983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0aae5-8619-4cc5-8071-92c21ceb7e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:47.569983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0aae5-8619-4cc5-8071-92c21ceb7e43 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.570624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0aae5-8619-4cc5-8071-92c21ceb7e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.570906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0aae5-8619-4cc5-8071-92c21ceb7e43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.584588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 247/489] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:47.584588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f5960-a6c0-4e82-9e30-8d3b833be4f4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.584588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f5960-a6c0-4e82-9e30-8d3b833be4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.584588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f5960-a6c0-4e82-9e30-8d3b833be4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.586319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0aae5-8619-4cc5-8071-92c21ceb7e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-c7a0aae5-8619-4cc5-8071-92c21ceb7e43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:47.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:47.592567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 243/490] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:47.598848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d5f2-bae3-4c2b-b724-f3f6084b71a1 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.599594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d5f2-bae3-4c2b-b724-f3f6084b71a1 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.599594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d5f2-bae3-4c2b-b724-f3f6084b71a1 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.599594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 244/491] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:47.599594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50d5f2-bae3-4c2b-b724-f3f6084b71a1 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:47.607950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-700f5960-a6c0-4e82-9e30-8d3b833be4f4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:47.609200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-700f5960-a6c0-4e82-9e30-8d3b833be4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:47.631732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:47.660453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:47.687553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 248/492] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:47.688933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f5960-a6c0-4e82-9e30-8d3b833be4f4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:47.731513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50d5f2-bae3-4c2b-b724-f3f6084b71a1 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:47.772687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb038e4-61df-4bf4-89b9-2e0a49271642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:47.773374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb038e4-61df-4bf4-89b9-2e0a49271642 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.773660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb038e4-61df-4bf4-89b9-2e0a49271642 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.773937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb038e4-61df-4bf4-89b9-2e0a49271642 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.782492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb038e4-61df-4bf4-89b9-2e0a49271642 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:47.783970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb038e4-61df-4bf4-89b9-2e0a49271642 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-8eb038e4-61df-4bf4-89b9-2e0a49271642 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:44:47.798671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:47.799611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:47.801178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 245/493] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:47.802105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde7158-f742-4505-b136-ce90c06a5002 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.802223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde7158-f742-4505-b136-ce90c06a5002 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.802507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde7158-f742-4505-b136-ce90c06a5002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.804033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f5960-a6c0-4e82-9e30-8d3b833be4f4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:47.823730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6cde7158-f742-4505-b136-ce90c06a5002 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:47.824954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6cde7158-f742-4505-b136-ce90c06a5002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:47.852683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81de4f-8322-4ad1-a287-9e196ce9fd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:47.853380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81de4f-8322-4ad1-a287-9e196ce9fd1b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.853668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81de4f-8322-4ad1-a287-9e196ce9fd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.854505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81de4f-8322-4ad1-a287-9e196ce9fd1b None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.854659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81de4f-8322-4ad1-a287-9e196ce9fd1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:47.854957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81de4f-8322-4ad1-a287-9e196ce9fd1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:47.856350 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81de4f-8322-4ad1-a287-9e196ce9fd1b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:47.866154 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 249/494] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:44:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:47.867091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81de4f-8322-4ad1-a287-9e196ce9fd1b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:47.906237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 246/495] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:47.907093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde7158-f742-4505-b136-ce90c06a5002 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:47.916646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:47.926001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:47.983769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81de4f-8322-4ad1-a287-9e196ce9fd1b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.017173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde7158-f742-4505-b136-ce90c06a5002 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.018884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422c377-5829-4d6d-a4c2-ad415ba0e9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:48.019780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422c377-5829-4d6d-a4c2-ad415ba0e9ec None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.020159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422c377-5829-4d6d-a4c2-ad415ba0e9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.020440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422c377-5829-4d6d-a4c2-ad415ba0e9ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.030956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422c377-5829-4d6d-a4c2-ad415ba0e9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7422c377-5829-4d6d-a4c2-ad415ba0e9ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:48.037308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:48.038213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:48.039004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 250/496] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:48.039647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44377a2c-7c62-4af8-8ecb-5a945c1ca61e None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.039974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44377a2c-7c62-4af8-8ecb-5a945c1ca61e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.040127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44377a2c-7c62-4af8-8ecb-5a945c1ca61e None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.041393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 251/497] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:48.042183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44377a2c-7c62-4af8-8ecb-5a945c1ca61e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:48.059727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27cc5-b922-4202-896f-1d8e1a40f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:48.060348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27cc5-b922-4202-896f-1d8e1a40f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.060625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27cc5-b922-4202-896f-1d8e1a40f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.060895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27cc5-b922-4202-896f-1d8e1a40f8a4 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.061722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27cc5-b922-4202-896f-1d8e1a40f8a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:48.062025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27cc5-b922-4202-896f-1d8e1a40f8a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:48.063471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27cc5-b922-4202-896f-1d8e1a40f8a4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:48.101453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 247/498] 10.222.0.55 () {56 vars in 1137 bytes} [Mon Jul 25 22:44:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:48.102364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27cc5-b922-4202-896f-1d8e1a40f8a4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:48.144692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:48.148669 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44377a2c-7c62-4af8-8ecb-5a945c1ca61e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.176441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:48.185869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14674a99-4e12-434a-9ccf-3b045dcc9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:48.186514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14674a99-4e12-434a-9ccf-3b045dcc9a2e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.186846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14674a99-4e12-434a-9ccf-3b045dcc9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.187087 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14674a99-4e12-434a-9ccf-3b045dcc9a2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.197384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14674a99-4e12-434a-9ccf-3b045dcc9a2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:48.198859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14674a99-4e12-434a-9ccf-3b045dcc9a2e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:48.206320 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27cc5-b922-4202-896f-1d8e1a40f8a4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-14674a99-4e12-434a-9ccf-3b045dcc9a2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:48.213839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:48.214682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:48.215513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:48.215513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:48.215513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:48.215513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:48.215513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 252/499] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:48.215928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14674a99-4e12-434a-9ccf-3b045dcc9a2e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:48.245352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7db8b-c99e-4460-90da-ab629e5b670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:48.246019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7db8b-c99e-4460-90da-ab629e5b670d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.246303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7db8b-c99e-4460-90da-ab629e5b670d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.246588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7db8b-c99e-4460-90da-ab629e5b670d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.256947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7db8b-c99e-4460-90da-ab629e5b670d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:48.258477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7db8b-c99e-4460-90da-ab629e5b670d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1ac7db8b-c99e-4460-90da-ab629e5b670d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:48.274373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:48.275285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:48.276112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:48.276112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:48.276112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:48.276112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:48.276112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 248/500] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:48.276782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d97ea9-600f-4272-90f5-18cecd743dea None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.277071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d97ea9-600f-4272-90f5-18cecd743dea None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.277366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d97ea9-600f-4272-90f5-18cecd743dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.297000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-30d97ea9-600f-4272-90f5-18cecd743dea None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:48.298265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-30d97ea9-600f-4272-90f5-18cecd743dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:48.322280 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14674a99-4e12-434a-9ccf-3b045dcc9a2e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.357715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46ea7d-e74e-440d-82f1-67e45d65142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:48.358343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ea7d-e74e-440d-82f1-67e45d65142a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.358625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ea7d-e74e-440d-82f1-67e45d65142a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.358902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ea7d-e74e-440d-82f1-67e45d65142a None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.359633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46ea7d-e74e-440d-82f1-67e45d65142a None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:48.359939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46ea7d-e74e-440d-82f1-67e45d65142a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:48.361351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46ea7d-e74e-440d-82f1-67e45d65142a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:48.370639 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 253/501] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:48.371502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46ea7d-e74e-440d-82f1-67e45d65142a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:48.382773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 249/502] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:48.382773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d97ea9-600f-4272-90f5-18cecd743dea None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:48.389216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:48.430784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:48.476704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46ea7d-e74e-440d-82f1-67e45d65142a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.477106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d97ea9-600f-4272-90f5-18cecd743dea None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.510835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567b1a2-8aea-4557-9189-e8d4cd2a82b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:48.511450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567b1a2-8aea-4557-9189-e8d4cd2a82b8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.511728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567b1a2-8aea-4557-9189-e8d4cd2a82b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.512001 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567b1a2-8aea-4557-9189-e8d4cd2a82b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.513541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb125b7-33e1-4bcb-ba23-006d29f0169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:48.514157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb125b7-33e1-4bcb-ba23-006d29f0169b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.514451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb125b7-33e1-4bcb-ba23-006d29f0169b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.514726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb125b7-33e1-4bcb-ba23-006d29f0169b None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.515420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb125b7-33e1-4bcb-ba23-006d29f0169b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:48.515727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb125b7-33e1-4bcb-ba23-006d29f0169b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:48.517136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb125b7-33e1-4bcb-ba23-006d29f0169b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:48.528935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 250/503] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:48.529785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb125b7-33e1-4bcb-ba23-006d29f0169b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:48.583288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567b1a2-8aea-4557-9189-e8d4cd2a82b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:48.584758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567b1a2-8aea-4557-9189-e8d4cd2a82b8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:48.599674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:48.640641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb125b7-33e1-4bcb-ba23-006d29f0169b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.656270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:48.680098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addcc08-e13d-4633-8138-33499a2a001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:48.680732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addcc08-e13d-4633-8138-33499a2a001d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.681132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addcc08-e13d-4633-8138-33499a2a001d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.681340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addcc08-e13d-4633-8138-33499a2a001d None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.682045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addcc08-e13d-4633-8138-33499a2a001d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:48.682364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addcc08-e13d-4633-8138-33499a2a001d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:48.683821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addcc08-e13d-4633-8138-33499a2a001d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:48.696011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 254/504] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:48.696903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567b1a2-8aea-4557-9189-e8d4cd2a82b8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:48.703738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 251/505] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:48.703738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addcc08-e13d-4633-8138-33499a2a001d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:48.805815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567b1a2-8aea-4557-9189-e8d4cd2a82b8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.809103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addcc08-e13d-4633-8138-33499a2a001d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.822061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:48.843830 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3fdf5-2870-4dde-af14-bac4c4243562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:48.844477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3fdf5-2870-4dde-af14-bac4c4243562 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.844751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3fdf5-2870-4dde-af14-bac4c4243562 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.845079 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3fdf5-2870-4dde-af14-bac4c4243562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.846363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4e3d-29b8-4544-855f-e1eb85621abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:48.847029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4e3d-29b8-4544-855f-e1eb85621abb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:48.847344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4e3d-29b8-4544-855f-e1eb85621abb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:48.847616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4e3d-29b8-4544-855f-e1eb85621abb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:48.857354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3fdf5-2870-4dde-af14-bac4c4243562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:48.858831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3fdf5-2870-4dde-af14-bac4c4243562 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:48.860051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c4e3d-29b8-4544-855f-e1eb85621abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b86c4e3d-29b8-4544-855f-e1eb85621abb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:48.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:48.866102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:48.866881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 252/506] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:48.868788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4e3d-29b8-4544-855f-e1eb85621abb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-aac3fdf5-2870-4dde-af14-bac4c4243562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:48.874781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:48.875765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:48.876593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:48.876593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:48.876593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:48.876593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:48.881066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 255/507] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:48.881881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3fdf5-2870-4dde-af14-bac4c4243562 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:48.906294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:48.975549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4e3d-29b8-4544-855f-e1eb85621abb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:48.982592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3fdf5-2870-4dde-af14-bac4c4243562 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:49.010929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e1e48-8e3e-4c37-b5dd-bd0cd3eee48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.011595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e1e48-8e3e-4c37-b5dd-bd0cd3eee48f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.011878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e1e48-8e3e-4c37-b5dd-bd0cd3eee48f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.012162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e1e48-8e3e-4c37-b5dd-bd0cd3eee48f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.016788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8510373-7a8f-4804-87d4-f79c7d1f03fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.017464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8510373-7a8f-4804-87d4-f79c7d1f03fc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.017745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8510373-7a8f-4804-87d4-f79c7d1f03fc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.018018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8510373-7a8f-4804-87d4-f79c7d1f03fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.020063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e1e48-8e3e-4c37-b5dd-bd0cd3eee48f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.021689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e1e48-8e3e-4c37-b5dd-bd0cd3eee48f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.029726 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8510373-7a8f-4804-87d4-f79c7d1f03fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.031155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8510373-7a8f-4804-87d4-f79c7d1f03fc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-852e1e48-8e3e-4c37-b5dd-bd0cd3eee48f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:44:49.033314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:49.034348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 253/508] 10.222.0.55 () {56 vars in 1093 bytes} [Mon Jul 25 22:44:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:49.040363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e1e48-8e3e-4c37-b5dd-bd0cd3eee48f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b8510373-7a8f-4804-87d4-f79c7d1f03fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:49.047515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:49.048510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:49.049582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:49.049582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:49.049582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:49.049582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:49.049582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 256/509] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:49.049910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8510373-7a8f-4804-87d4-f79c7d1f03fc None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:49.071711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:49.135994 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:49.142760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e1e48-8e3e-4c37-b5dd-bd0cd3eee48f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:49.155486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8510373-7a8f-4804-87d4-f79c7d1f03fc None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:49.178749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db731f37-f3af-49ad-97e0-d5ee91907451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.179358 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db731f37-f3af-49ad-97e0-d5ee91907451 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.179636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db731f37-f3af-49ad-97e0-d5ee91907451 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.179909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db731f37-f3af-49ad-97e0-d5ee91907451 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.180580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db731f37-f3af-49ad-97e0-d5ee91907451 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.182066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db731f37-f3af-49ad-97e0-d5ee91907451 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.191853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d686b-4bf4-449f-bf05-aafb2942dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.192483 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d686b-4bf4-449f-bf05-aafb2942dd28 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.192763 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d686b-4bf4-449f-bf05-aafb2942dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.193036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d686b-4bf4-449f-bf05-aafb2942dd28 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.193780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d686b-4bf4-449f-bf05-aafb2942dd28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:49.194080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d686b-4bf4-449f-bf05-aafb2942dd28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.195440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d686b-4bf4-449f-bf05-aafb2942dd28 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.203560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 257/510] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:49.205925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d686b-4bf4-449f-bf05-aafb2942dd28 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:49.284366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 254/511] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:44:49 2022] POST /identity/v3/users => generated 247 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:44:49.285796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db731f37-f3af-49ad-97e0-d5ee91907451 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:49.295301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:49.320205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d686b-4bf4-449f-bf05-aafb2942dd28 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:49.369057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5d4f6-3f33-4d42-b9f1-96fb7073b906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.369863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d4f6-3f33-4d42-b9f1-96fb7073b906 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.370083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d4f6-3f33-4d42-b9f1-96fb7073b906 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.370283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d4f6-3f33-4d42-b9f1-96fb7073b906 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.371070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5d4f6-3f33-4d42-b9f1-96fb7073b906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:49.371502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5d4f6-3f33-4d42-b9f1-96fb7073b906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.373163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5d4f6-3f33-4d42-b9f1-96fb7073b906 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.391891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 258/512] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:49.391891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5d4f6-3f33-4d42-b9f1-96fb7073b906 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:49.421129 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db731f37-f3af-49ad-97e0-d5ee91907451 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:49.465396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feabea-fc92-4b1b-b81e-a665f877cebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.465617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feabea-fc92-4b1b-b81e-a665f877cebd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.465896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feabea-fc92-4b1b-b81e-a665f877cebd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.466124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feabea-fc92-4b1b-b81e-a665f877cebd None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.466927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61feabea-fc92-4b1b-b81e-a665f877cebd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:49.467238 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61feabea-fc92-4b1b-b81e-a665f877cebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.468704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61feabea-fc92-4b1b-b81e-a665f877cebd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.491909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 255/513] 10.222.0.55 () {56 vars in 1133 bytes} [Mon Jul 25 22:44:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:49.492845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feabea-fc92-4b1b-b81e-a665f877cebd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:49.504835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:49.517963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5d4f6-3f33-4d42-b9f1-96fb7073b906 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:49.554687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e350bbf-4742-4dd4-a544-4a91af3b46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.555227 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350bbf-4742-4dd4-a544-4a91af3b46b8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.555502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350bbf-4742-4dd4-a544-4a91af3b46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.555770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350bbf-4742-4dd4-a544-4a91af3b46b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.556464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e350bbf-4742-4dd4-a544-4a91af3b46b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:49.556770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e350bbf-4742-4dd4-a544-4a91af3b46b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.558181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e350bbf-4742-4dd4-a544-4a91af3b46b8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.567126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:49.570472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 259/514] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:49.571336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e350bbf-4742-4dd4-a544-4a91af3b46b8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:49.608765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feabea-fc92-4b1b-b81e-a665f877cebd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:49.644874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c62e5-48a2-4861-93aa-72aabb8807c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.645542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c62e5-48a2-4861-93aa-72aabb8807c1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.645816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c62e5-48a2-4861-93aa-72aabb8807c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.646083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c62e5-48a2-4861-93aa-72aabb8807c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.656948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c62e5-48a2-4861-93aa-72aabb8807c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.658452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c62e5-48a2-4861-93aa-72aabb8807c1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-783c62e5-48a2-4861-93aa-72aabb8807c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:49.674138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:49.675297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:49.677222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:49.677222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:49.677222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:49.677222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:49.680801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 256/515] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:49.681940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c62e5-48a2-4861-93aa-72aabb8807c1 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:49.690007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e350bbf-4742-4dd4-a544-4a91af3b46b8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:49.728339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5c8f5-f2c7-48e3-96d3-8a78e72b3f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.729291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5c8f5-f2c7-48e3-96d3-8a78e72b3f87 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.729744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5c8f5-f2c7-48e3-96d3-8a78e72b3f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.730258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5c8f5-f2c7-48e3-96d3-8a78e72b3f87 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.739416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5c8f5-f2c7-48e3-96d3-8a78e72b3f87 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.740917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5c8f5-f2c7-48e3-96d3-8a78e72b3f87 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.745143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-53d5c8f5-f2c7-48e3-96d3-8a78e72b3f87 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:44:49.756186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:49.764816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 260/516] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:49.765729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5c8f5-f2c7-48e3-96d3-8a78e72b3f87 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:49.797770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c62e5-48a2-4861-93aa-72aabb8807c1 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:49.829394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:49.839506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf9f97-0267-480d-9ddc-f57cb8a09578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.840133 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf9f97-0267-480d-9ddc-f57cb8a09578 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.840418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf9f97-0267-480d-9ddc-f57cb8a09578 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf9f97-0267-480d-9ddc-f57cb8a09578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.880973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5c8f5-f2c7-48e3-96d3-8a78e72b3f87 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:49.918781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a025d-1ce7-4879-b094-92767c0bf578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:49.919019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf9f97-0267-480d-9ddc-f57cb8a09578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.919431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a025d-1ce7-4879-b094-92767c0bf578 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:49.919717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a025d-1ce7-4879-b094-92767c0bf578 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:49.919994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a025d-1ce7-4879-b094-92767c0bf578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:49.920336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf9f97-0267-480d-9ddc-f57cb8a09578 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.929298 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a025d-1ce7-4879-b094-92767c0bf578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:49.930758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a025d-1ce7-4879-b094-92767c0bf578 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5d8a025d-1ce7-4879-b094-92767c0bf578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:44:49.946210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:49.947124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:49.947969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:44:49.947969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:44:49.947969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:44:49.947969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:44:49.947969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:44:49.947969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:44:49.947969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:49.947969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:49.947969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 261/517] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:49.948451 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a025d-1ce7-4879-b094-92767c0bf578 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:49.986835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.032722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 257/518] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:50.034599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf9f97-0267-480d-9ddc-f57cb8a09578 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.057376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a025d-1ce7-4879-b094-92767c0bf578 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:50.077908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.097962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e31c0-9093-4b5d-881c-edf623984199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:50.097962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e31c0-9093-4b5d-881c-edf623984199 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.097962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e31c0-9093-4b5d-881c-edf623984199 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.097962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e31c0-9093-4b5d-881c-edf623984199 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.098612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e31c0-9093-4b5d-881c-edf623984199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:50.098612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e31c0-9093-4b5d-881c-edf623984199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:50.098612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e31c0-9093-4b5d-881c-edf623984199 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:50.109208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 262/519] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:50.110082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e31c0-9093-4b5d-881c-edf623984199 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.147462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf9f97-0267-480d-9ddc-f57cb8a09578 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:50.185641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b65d3-6606-4a86-9509-51754ab49b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:50.186265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b65d3-6606-4a86-9509-51754ab49b2d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.186548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b65d3-6606-4a86-9509-51754ab49b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.186823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b65d3-6606-4a86-9509-51754ab49b2d None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.187734 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b65d3-6606-4a86-9509-51754ab49b2d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:50.188168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b65d3-6606-4a86-9509-51754ab49b2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:50.189676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b65d3-6606-4a86-9509-51754ab49b2d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:50.210131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 258/520] 10.222.0.55 () {56 vars in 1137 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:50.210979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b65d3-6606-4a86-9509-51754ab49b2d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.219251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e31c0-9093-4b5d-881c-edf623984199 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:50.235565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.256580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93a04a-8a35-4984-ba41-5af360a672da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:50.257334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93a04a-8a35-4984-ba41-5af360a672da None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.257622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93a04a-8a35-4984-ba41-5af360a672da None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.257900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93a04a-8a35-4984-ba41-5af360a672da None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.258667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93a04a-8a35-4984-ba41-5af360a672da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:50.258977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93a04a-8a35-4984-ba41-5af360a672da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:50.260799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93a04a-8a35-4984-ba41-5af360a672da None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:50.280264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 263/521] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:50.280944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93a04a-8a35-4984-ba41-5af360a672da None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.327793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.339444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b65d3-6606-4a86-9509-51754ab49b2d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:50.381710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf1672-3eb5-43de-a895-d691e697e518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:50.382354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf1672-3eb5-43de-a895-d691e697e518 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.382637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf1672-3eb5-43de-a895-d691e697e518 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.382916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf1672-3eb5-43de-a895-d691e697e518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.389408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93a04a-8a35-4984-ba41-5af360a672da None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:50.395652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf1672-3eb5-43de-a895-d691e697e518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:50.397159 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf1672-3eb5-43de-a895-d691e697e518 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-bfdf1672-3eb5-43de-a895-d691e697e518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:50.414176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:50.415064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:50.415883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:50.415883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:50.415883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:50.415883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:50.415883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 259/522] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:50.416148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf1672-3eb5-43de-a895-d691e697e518 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.436759 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996c7e0-583d-4fea-91ab-1f0d7d2e59ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:50.437441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996c7e0-583d-4fea-91ab-1f0d7d2e59ab None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.437782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996c7e0-583d-4fea-91ab-1f0d7d2e59ab None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.438062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996c7e0-583d-4fea-91ab-1f0d7d2e59ab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.446456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996c7e0-583d-4fea-91ab-1f0d7d2e59ab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:50.447938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996c7e0-583d-4fea-91ab-1f0d7d2e59ab None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-1996c7e0-583d-4fea-91ab-1f0d7d2e59ab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:44:50.465038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:50.466401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:50.467290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 264/523] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:50.473622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996c7e0-583d-4fea-91ab-1f0d7d2e59ab None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.493470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.529831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf1672-3eb5-43de-a895-d691e697e518 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:50.570167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460e8f-71ac-4746-8346-c9d2794026f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:50.570794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460e8f-71ac-4746-8346-c9d2794026f2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.571076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460e8f-71ac-4746-8346-c9d2794026f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.571351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460e8f-71ac-4746-8346-c9d2794026f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.586163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.589712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996c7e0-583d-4fea-91ab-1f0d7d2e59ab None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:50.626568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60174036-84f9-4f38-865f-e61c402fb0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:50.627228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174036-84f9-4f38-865f-e61c402fb0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.627528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174036-84f9-4f38-865f-e61c402fb0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.627761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174036-84f9-4f38-865f-e61c402fb0c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.629170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60174036-84f9-4f38-865f-e61c402fb0c2 None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=a911a544e17e4fafb579da66973c431f) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:50.629491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60174036-84f9-4f38-865f-e61c402fb0c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:50.630945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60174036-84f9-4f38-865f-e61c402fb0c2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:50.636857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 265/524] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/role_assignments?user.id=a911a544e17e4fafb579da66973c431f&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:50.637949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60174036-84f9-4f38-865f-e61c402fb0c2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.663227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac460e8f-71ac-4746-8346-c9d2794026f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:50.664739 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac460e8f-71ac-4746-8346-c9d2794026f2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:50.758941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.794005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60174036-84f9-4f38-865f-e61c402fb0c2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:50.796605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 260/525] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:50.797503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460e8f-71ac-4746-8346-c9d2794026f2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.836318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba87e21-73fb-4bcc-b32f-4e82bac5f017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:50.837511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba87e21-73fb-4bcc-b32f-4e82bac5f017 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.838009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba87e21-73fb-4bcc-b32f-4e82bac5f017 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.838517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba87e21-73fb-4bcc-b32f-4e82bac5f017 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.839436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba87e21-73fb-4bcc-b32f-4e82bac5f017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:50.839945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba87e21-73fb-4bcc-b32f-4e82bac5f017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:50.841596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba87e21-73fb-4bcc-b32f-4e82bac5f017 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:50.858778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 266/526] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:50.859932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba87e21-73fb-4bcc-b32f-4e82bac5f017 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.921670 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.942973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460e8f-71ac-4746-8346-c9d2794026f2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:50.993986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02942390-e2c4-40ed-8fbc-8066b92444bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:50.994762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02942390-e2c4-40ed-8fbc-8066b92444bd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.995150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02942390-e2c4-40ed-8fbc-8066b92444bd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.995428 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02942390-e2c4-40ed-8fbc-8066b92444bd None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.996245 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02942390-e2c4-40ed-8fbc-8066b92444bd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:50.996552 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02942390-e2c4-40ed-8fbc-8066b92444bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:50.999066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02942390-e2c4-40ed-8fbc-8066b92444bd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:51.001398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba87e21-73fb-4bcc-b32f-4e82bac5f017 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:51.024121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 261/527] 10.222.0.55 () {56 vars in 1139 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:51.025152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02942390-e2c4-40ed-8fbc-8066b92444bd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:51.055341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42be145-4ccb-47c6-a15f-9f4df992bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:51.056683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42be145-4ccb-47c6-a15f-9f4df992bafd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:51.057219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42be145-4ccb-47c6-a15f-9f4df992bafd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:51.057950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42be145-4ccb-47c6-a15f-9f4df992bafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:51.062297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:51.074058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42be145-4ccb-47c6-a15f-9f4df992bafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:51.077570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42be145-4ccb-47c6-a15f-9f4df992bafd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-e42be145-4ccb-47c6-a15f-9f4df992bafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:51.103771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:51.104697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:51.106134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:51.106134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:51.106134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:51.106134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:51.111928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 267/528] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:51.111928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42be145-4ccb-47c6-a15f-9f4df992bafd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:51.217261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02942390-e2c4-40ed-8fbc-8066b92444bd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:51.262510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c51453-3a34-4339-83a8-c0aef80696df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:51.263163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c51453-3a34-4339-83a8-c0aef80696df None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:51.263446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c51453-3a34-4339-83a8-c0aef80696df None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:51.263721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c51453-3a34-4339-83a8-c0aef80696df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:51.273929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c51453-3a34-4339-83a8-c0aef80696df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:51.275497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c51453-3a34-4339-83a8-c0aef80696df None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:51.279423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-37c51453-3a34-4339-83a8-c0aef80696df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:44:51.293259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:51.294669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:51.295490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:44:51.295490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:44:51.295490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:44:51.295490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:44:51.295490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:44:51.295490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:44:51.295490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:51.295490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:51.295490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 262/529] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:51.295947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c51453-3a34-4339-83a8-c0aef80696df None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:51.310664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42be145-4ccb-47c6-a15f-9f4df992bafd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:51.364773 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34859eb-79bf-4d47-b055-c94742bbef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:51.366079 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34859eb-79bf-4d47-b055-c94742bbef83 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:51.366560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34859eb-79bf-4d47-b055-c94742bbef83 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:51.367283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34859eb-79bf-4d47-b055-c94742bbef83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:51.404283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:51.422944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c51453-3a34-4339-83a8-c0aef80696df None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:51.457874 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34859eb-79bf-4d47-b055-c94742bbef83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:51.459524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34859eb-79bf-4d47-b055-c94742bbef83 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:51.468678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456478a5-90fc-4026-9975-c946c995354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:51.469255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456478a5-90fc-4026-9975-c946c995354c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:51.469536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456478a5-90fc-4026-9975-c946c995354c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:51.469808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456478a5-90fc-4026-9975-c946c995354c None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:51.470636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456478a5-90fc-4026-9975-c946c995354c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:51.470925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456478a5-90fc-4026-9975-c946c995354c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:51.472498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456478a5-90fc-4026-9975-c946c995354c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:51.491597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 263/530] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:51.491597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456478a5-90fc-4026-9975-c946c995354c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:51.553274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:51.582661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 268/531] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:44:51.582661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5eb4e-9811-496f-979b-1911fadd20d2 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:51.582661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5eb4e-9811-496f-979b-1911fadd20d2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:51.582661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5eb4e-9811-496f-979b-1911fadd20d2 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:51.582661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 269/532] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:51.582661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5eb4e-9811-496f-979b-1911fadd20d2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:51.608396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456478a5-90fc-4026-9975-c946c995354c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:51.644993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad309f2-1db9-485b-9527-54e4e78cf9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:51.645845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad309f2-1db9-485b-9527-54e4e78cf9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:51.646129 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad309f2-1db9-485b-9527-54e4e78cf9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:51.646405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad309f2-1db9-485b-9527-54e4e78cf9c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:51.647153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad309f2-1db9-485b-9527-54e4e78cf9c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:51.647462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad309f2-1db9-485b-9527-54e4e78cf9c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:51.648902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad309f2-1db9-485b-9527-54e4e78cf9c9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:51.679410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 264/533] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:51.680420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad309f2-1db9-485b-9527-54e4e78cf9c9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:51.693183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:51.706902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5eb4e-9811-496f-979b-1911fadd20d2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:51.747682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5db04-df3b-427f-8661-17a810cbcd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:51.748273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5db04-df3b-427f-8661-17a810cbcd7d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:51.748562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5db04-df3b-427f-8661-17a810cbcd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:51.748833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5db04-df3b-427f-8661-17a810cbcd7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:51.757275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5db04-df3b-427f-8661-17a810cbcd7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:51.758757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5db04-df3b-427f-8661-17a810cbcd7d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4ef5db04-df3b-427f-8661-17a810cbcd7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:44:51.772126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:51.773026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:51.773924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:44:51.773924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:44:51.773924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:44:51.773924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:44:51.773924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:44:51.773924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:44:51.773924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:51.773924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:51.773924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 270/534] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:51.774864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da4cc7-fb60-43d8-aa84-b8d96e71e854 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:51.774978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da4cc7-fb60-43d8-aa84-b8d96e71e854 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:51.775647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da4cc7-fb60-43d8-aa84-b8d96e71e854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:51.796693 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-82da4cc7-fb60-43d8-aa84-b8d96e71e854 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:51.797987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-82da4cc7-fb60-43d8-aa84-b8d96e71e854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:51.807452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad309f2-1db9-485b-9527-54e4e78cf9c9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:51.832323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:51.868469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e1ab-a1ce-4367-884b-6fdb6c00ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:51.869677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e1ab-a1ce-4367-884b-6fdb6c00ab19 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:51.869965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e1ab-a1ce-4367-884b-6fdb6c00ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:51.870409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e1ab-a1ce-4367-884b-6fdb6c00ab19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:51.883070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e1ab-a1ce-4367-884b-6fdb6c00ab19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:51.884652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e1ab-a1ce-4367-884b-6fdb6c00ab19 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:51.886210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 271/535] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:51.898100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da4cc7-fb60-43d8-aa84-b8d96e71e854 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-d9a5e1ab-a1ce-4367-884b-6fdb6c00ab19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:51.902590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:51.903493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:51.904316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:51.904316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:51.904316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:51.904316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:51.904316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 265/536] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:51.905299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e1ab-a1ce-4367-884b-6fdb6c00ab19 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:51.989450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:52.037302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da4cc7-fb60-43d8-aa84-b8d96e71e854 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:52.059301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e1ab-a1ce-4367-884b-6fdb6c00ab19 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:52.094147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea138fe-9661-49a4-ad89-8c1e81e27fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:52.095175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea138fe-9661-49a4-ad89-8c1e81e27fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:52.095607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea138fe-9661-49a4-ad89-8c1e81e27fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:52.096026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea138fe-9661-49a4-ad89-8c1e81e27fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:52.097910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea138fe-9661-49a4-ad89-8c1e81e27fe8 None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=eea60163008a4bea95d130a5809fc50d) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:52.098406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea138fe-9661-49a4-ad89-8c1e81e27fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:52.100963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea138fe-9661-49a4-ad89-8c1e81e27fe8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:52.109737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 272/537] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:51 2022] GET /identity/v3/role_assignments?user.id=eea60163008a4bea95d130a5809fc50d&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:52.110750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea138fe-9661-49a4-ad89-8c1e81e27fe8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:52.128675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565e80-3980-479c-a5a5-81735ff5ae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:52.129687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565e80-3980-479c-a5a5-81735ff5ae84 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:52.130054 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565e80-3980-479c-a5a5-81735ff5ae84 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:52.130406 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565e80-3980-479c-a5a5-81735ff5ae84 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:52.131433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3565e80-3980-479c-a5a5-81735ff5ae84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:52.131826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3565e80-3980-479c-a5a5-81735ff5ae84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:52.133528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3565e80-3980-479c-a5a5-81735ff5ae84 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:52.156070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 266/538] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:52.156070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565e80-3980-479c-a5a5-81735ff5ae84 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:52.164532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:52.274593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea138fe-9661-49a4-ad89-8c1e81e27fe8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:52.334552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781c650-a869-4908-88a2-d8c246c5fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:52.335197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781c650-a869-4908-88a2-d8c246c5fa47 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:52.335566 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781c650-a869-4908-88a2-d8c246c5fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:52.335909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781c650-a869-4908-88a2-d8c246c5fa47 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:52.336814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781c650-a869-4908-88a2-d8c246c5fa47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:52.337213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781c650-a869-4908-88a2-d8c246c5fa47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:52.338795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781c650-a869-4908-88a2-d8c246c5fa47 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:52.349268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565e80-3980-479c-a5a5-81735ff5ae84 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:52.357847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 273/539] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:52.359294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781c650-a869-4908-88a2-d8c246c5fa47 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:52.376021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:52.396152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d611c72-9acc-406d-9217-7e31a9b2420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:52.397365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611c72-9acc-406d-9217-7e31a9b2420e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:52.398230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611c72-9acc-406d-9217-7e31a9b2420e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:52.399062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611c72-9acc-406d-9217-7e31a9b2420e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:52.413692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d611c72-9acc-406d-9217-7e31a9b2420e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-5d611c72-9acc-406d-9217-7e31a9b2420e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:52.420590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:52.421553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:52.422342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:52.423609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 267/540] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:52.424976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d611c72-9acc-406d-9217-7e31a9b2420e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:52.481406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:52.494827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781c650-a869-4908-88a2-d8c246c5fa47 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:52.542517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4d24c-18e2-4da8-b067-9197eed30341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:52.543690 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4d24c-18e2-4da8-b067-9197eed30341 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:52.544495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4d24c-18e2-4da8-b067-9197eed30341 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:52.545308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4d24c-18e2-4da8-b067-9197eed30341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:52.546477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4d24c-18e2-4da8-b067-9197eed30341 None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=3ccf6c1a5c044294a8eb83c877a6316e) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:52.547311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4d24c-18e2-4da8-b067-9197eed30341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:52.549281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4d24c-18e2-4da8-b067-9197eed30341 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:52.549926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d611c72-9acc-406d-9217-7e31a9b2420e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:52.560435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 274/541] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:52 2022] GET /identity/v3/role_assignments?user.id=3ccf6c1a5c044294a8eb83c877a6316e&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:52.567661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4d24c-18e2-4da8-b067-9197eed30341 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:52.623492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111acff3-e310-4baf-8775-c4cc049aaca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:52.624218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111acff3-e310-4baf-8775-c4cc049aaca6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:52.624424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111acff3-e310-4baf-8775-c4cc049aaca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:52.624699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111acff3-e310-4baf-8775-c4cc049aaca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:52.638807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111acff3-e310-4baf-8775-c4cc049aaca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:52.640308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111acff3-e310-4baf-8775-c4cc049aaca6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-111acff3-e310-4baf-8775-c4cc049aaca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:44:52.668368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:52.669309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:52.670176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:44:52.670176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:44:52.670176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:44:52.670176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:44:52.670176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:44:52.670176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:44:52.670176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:52.670176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:52.679136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 268/542] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:52.681503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111acff3-e310-4baf-8775-c4cc049aaca6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:52.765050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:52.777463 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4d24c-18e2-4da8-b067-9197eed30341 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:52.837163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111acff3-e310-4baf-8775-c4cc049aaca6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:52.854042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee9387-2b41-4796-acf5-1938ef1dbb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:52.857663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee9387-2b41-4796-acf5-1938ef1dbb8e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:52.857948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee9387-2b41-4796-acf5-1938ef1dbb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:52.858223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee9387-2b41-4796-acf5-1938ef1dbb8e None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:52.858961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee9387-2b41-4796-acf5-1938ef1dbb8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:52.859269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee9387-2b41-4796-acf5-1938ef1dbb8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:52.860777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee9387-2b41-4796-acf5-1938ef1dbb8e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:52.871275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 275/543] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:52.876930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808f07-6693-4c5f-8433-b4f501033bc4 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:52.876930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808f07-6693-4c5f-8433-b4f501033bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:52.876930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808f07-6693-4c5f-8433-b4f501033bc4 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:52.878776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 276/544] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:52.879812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808f07-6693-4c5f-8433-b4f501033bc4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:52.893802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c7ac8-8765-4f96-bde3-12bbbbafb434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:52.895231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c7ac8-8765-4f96-bde3-12bbbbafb434 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:52.895771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c7ac8-8765-4f96-bde3-12bbbbafb434 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:52.896522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c7ac8-8765-4f96-bde3-12bbbbafb434 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:52.898080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c7ac8-8765-4f96-bde3-12bbbbafb434 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:52.898889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c7ac8-8765-4f96-bde3-12bbbbafb434 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:52.900219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:52.902275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c7ac8-8765-4f96-bde3-12bbbbafb434 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:52.921809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 269/545] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:52.924693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ceb09-4a9c-457d-bf0a-88b94c362dfb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:52.925317 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ceb09-4a9c-457d-bf0a-88b94c362dfb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:52.926475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ceb09-4a9c-457d-bf0a-88b94c362dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:52.952096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-067ceb09-4a9c-457d-bf0a-88b94c362dfb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:52.954130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-067ceb09-4a9c-457d-bf0a-88b94c362dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:52.998698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808f07-6693-4c5f-8433-b4f501033bc4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:53.036886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0af6-c4b8-43ad-94fb-d1bd46644d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:53.037709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0af6-c4b8-43ad-94fb-d1bd46644d64 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:53.038114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0af6-c4b8-43ad-94fb-d1bd46644d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:53.038454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0af6-c4b8-43ad-94fb-d1bd46644d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:53.050787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f0af6-c4b8-43ad-94fb-d1bd46644d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:53.051456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 270/546] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:53.052856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ceb09-4a9c-457d-bf0a-88b94c362dfb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:53.058273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f0af6-c4b8-43ad-94fb-d1bd46644d64 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f62f0af6-c4b8-43ad-94fb-d1bd46644d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:53.083329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:53.084305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:53.085163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:53.085163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:53.085163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:53.085163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:53.090493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:53.091334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 277/547] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:53.092222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0af6-c4b8-43ad-94fb-d1bd46644d64 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:53.174600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ceb09-4a9c-457d-bf0a-88b94c362dfb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:53.186443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:53.215488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb316a45-4501-4c09-85a0-c3a1b75eec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:53.216135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb316a45-4501-4c09-85a0-c3a1b75eec81 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:53.216415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb316a45-4501-4c09-85a0-c3a1b75eec81 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:53.216688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb316a45-4501-4c09-85a0-c3a1b75eec81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:53.217587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb316a45-4501-4c09-85a0-c3a1b75eec81 None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=aa8cd52bd9f24f7d8ed93943aaaeaa9f) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:53.217898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb316a45-4501-4c09-85a0-c3a1b75eec81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:53.219395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb316a45-4501-4c09-85a0-c3a1b75eec81 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:53.227561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 271/548] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:53 2022] GET /identity/v3/role_assignments?user.id=aa8cd52bd9f24f7d8ed93943aaaeaa9f&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:53.228396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb316a45-4501-4c09-85a0-c3a1b75eec81 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:53.236857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0af6-c4b8-43ad-94fb-d1bd46644d64 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:53.289324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6e239-8a99-4879-b9f2-19e3e0b18537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:53.290644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6e239-8a99-4879-b9f2-19e3e0b18537 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:53.291140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6e239-8a99-4879-b9f2-19e3e0b18537 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:53.291633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6e239-8a99-4879-b9f2-19e3e0b18537 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:53.293333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6e239-8a99-4879-b9f2-19e3e0b18537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:53.294147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6e239-8a99-4879-b9f2-19e3e0b18537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:53.296580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6e239-8a99-4879-b9f2-19e3e0b18537 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:53.316380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 278/549] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:53.323689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6e239-8a99-4879-b9f2-19e3e0b18537 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:53.380013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:53.407238 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb316a45-4501-4c09-85a0-c3a1b75eec81 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:53.474429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6d49c-6614-43a3-a375-4fdedf9fbcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:53.474998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6d49c-6614-43a3-a375-4fdedf9fbcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:53.475281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6d49c-6614-43a3-a375-4fdedf9fbcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:53.475560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6d49c-6614-43a3-a375-4fdedf9fbcd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:53.477025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6e239-8a99-4879-b9f2-19e3e0b18537 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:53.489180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6d49c-6614-43a3-a375-4fdedf9fbcd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-04c6d49c-6614-43a3-a375-4fdedf9fbcd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:53.494686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:53.495649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:53.496484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:53.501194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 272/550] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:53.502695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6d49c-6614-43a3-a375-4fdedf9fbcd4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:53.522852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:53.534772 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67938b-0a56-4602-acb1-ec2c2efa8faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:53.536885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67938b-0a56-4602-acb1-ec2c2efa8faf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:53.536885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67938b-0a56-4602-acb1-ec2c2efa8faf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:53.537313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67938b-0a56-4602-acb1-ec2c2efa8faf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:53.545399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67938b-0a56-4602-acb1-ec2c2efa8faf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:53.547227 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67938b-0a56-4602-acb1-ec2c2efa8faf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2c67938b-0a56-4602-acb1-ec2c2efa8faf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:44:53.560473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:53.561470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:53.562360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:53.562360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:53.562360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:44:53.562360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:44:53.562360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:44:53.562360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:44:53.562360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:44:53.562360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:44:53.562360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:44:53.562360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:53.569874 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 279/551] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:44:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:53.572523 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67938b-0a56-4602-acb1-ec2c2efa8faf None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:53.622326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6d49c-6614-43a3-a375-4fdedf9fbcd4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:53.663969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c07557-f0dd-41a6-9207-06335d0f8509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:53.664722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07557-f0dd-41a6-9207-06335d0f8509 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:53.664968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07557-f0dd-41a6-9207-06335d0f8509 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:53.665152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07557-f0dd-41a6-9207-06335d0f8509 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:53.665896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c07557-f0dd-41a6-9207-06335d0f8509 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:53.666284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c07557-f0dd-41a6-9207-06335d0f8509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:53.668025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c07557-f0dd-41a6-9207-06335d0f8509 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:53.687208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 273/552] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:53.694219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c07557-f0dd-41a6-9207-06335d0f8509 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:53.735551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:53.775923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67938b-0a56-4602-acb1-ec2c2efa8faf None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:53.815152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485d147-c140-4e11-8a09-c6717f396409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:53.816112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d147-c140-4e11-8a09-c6717f396409 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:53.816401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d147-c140-4e11-8a09-c6717f396409 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:53.817188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d147-c140-4e11-8a09-c6717f396409 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:53.818673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485d147-c140-4e11-8a09-c6717f396409 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:53.819069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485d147-c140-4e11-8a09-c6717f396409 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:53.820530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485d147-c140-4e11-8a09-c6717f396409 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:53.890709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 280/553] 10.222.0.55 () {56 vars in 1135 bytes} [Mon Jul 25 22:44:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:53.897171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485d147-c140-4e11-8a09-c6717f396409 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:53.915896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c07557-f0dd-41a6-9207-06335d0f8509 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:53.973545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:53.997988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fa1cc-5ba8-4d30-85b4-bb19774c146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:53.997988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fa1cc-5ba8-4d30-85b4-bb19774c146d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:53.997988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fa1cc-5ba8-4d30-85b4-bb19774c146d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:53.997988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fa1cc-5ba8-4d30-85b4-bb19774c146d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.018641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fa1cc-5ba8-4d30-85b4-bb19774c146d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:54.020671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fa1cc-5ba8-4d30-85b4-bb19774c146d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-ce8fa1cc-5ba8-4d30-85b4-bb19774c146d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:54.048045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:54.049018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:54.049981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:54.049981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:54.049981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:54.049981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:54.051065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 274/554] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:54.057865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fa1cc-5ba8-4d30-85b4-bb19774c146d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:54.080983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485d147-c140-4e11-8a09-c6717f396409 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:54.120394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539e3cc-dd2b-4c3f-8652-3b49b05e17c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:54.121468 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539e3cc-dd2b-4c3f-8652-3b49b05e17c3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.125585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539e3cc-dd2b-4c3f-8652-3b49b05e17c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.125585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539e3cc-dd2b-4c3f-8652-3b49b05e17c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.157535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:54.198863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539e3cc-dd2b-4c3f-8652-3b49b05e17c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:54.200797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539e3cc-dd2b-4c3f-8652-3b49b05e17c3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:54.240387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fa1cc-5ba8-4d30-85b4-bb19774c146d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:54.252409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:54.318536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30df067-02b7-4d9f-9e87-2371600850be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:54.318934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 281/555] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:44:54.319183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30df067-02b7-4d9f-9e87-2371600850be None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.319492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30df067-02b7-4d9f-9e87-2371600850be None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.319869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30df067-02b7-4d9f-9e87-2371600850be None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.320491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30df067-02b7-4d9f-9e87-2371600850be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:54.320804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30df067-02b7-4d9f-9e87-2371600850be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:54.321766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539e3cc-dd2b-4c3f-8652-3b49b05e17c3 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:54.322409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30df067-02b7-4d9f-9e87-2371600850be None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:54.357237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 275/556] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:54.370596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30df067-02b7-4d9f-9e87-2371600850be None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:54.439153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539e3cc-dd2b-4c3f-8652-3b49b05e17c3 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:54.477493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14489876-d0bd-452a-b323-bc302f639780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:54.478143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14489876-d0bd-452a-b323-bc302f639780 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.478418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14489876-d0bd-452a-b323-bc302f639780 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.478689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14489876-d0bd-452a-b323-bc302f639780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.490549 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14489876-d0bd-452a-b323-bc302f639780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:54.492026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14489876-d0bd-452a-b323-bc302f639780 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:54.499705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-14489876-d0bd-452a-b323-bc302f639780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:54.513378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:54.514744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:54.515615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:54.515615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:54.515615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:54.515615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:54.515615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 282/557] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:54.516338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14489876-d0bd-452a-b323-bc302f639780 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:54.611662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30df067-02b7-4d9f-9e87-2371600850be None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:54.632220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14489876-d0bd-452a-b323-bc302f639780 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:54.660552 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:54.671357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f7153-bd09-418e-9ea7-83ffab8cf0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:54.677149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f7153-bd09-418e-9ea7-83ffab8cf0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.677149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f7153-bd09-418e-9ea7-83ffab8cf0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.677149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f7153-bd09-418e-9ea7-83ffab8cf0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.677149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f7153-bd09-418e-9ea7-83ffab8cf0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:54.677149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f7153-bd09-418e-9ea7-83ffab8cf0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:54.677525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f7153-bd09-418e-9ea7-83ffab8cf0b2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:54.685863 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf2606-3774-44be-9f9d-b20c228c08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:54.687134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf2606-3774-44be-9f9d-b20c228c08e4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.687606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf2606-3774-44be-9f9d-b20c228c08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.688063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf2606-3774-44be-9f9d-b20c228c08e4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.695892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 283/558] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:54.697202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f7153-bd09-418e-9ea7-83ffab8cf0b2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:54.697518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf2606-3774-44be-9f9d-b20c228c08e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:54.705144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf2606-3774-44be-9f9d-b20c228c08e4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1bbf2606-3774-44be-9f9d-b20c228c08e4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:44:54.731642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:54.732750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:54.733716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:54.733716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:54.733716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:44:54.733716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:44:54.733716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:44:54.733716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:44:54.733716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:44:54.733716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:44:54.733716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:44:54.733716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:54.734249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 276/559] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:44:54.740579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf2606-3774-44be-9f9d-b20c228c08e4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:54.831320 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:54.897882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f7153-bd09-418e-9ea7-83ffab8cf0b2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:54.944206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fb6ba-626c-43f3-a3ce-139a26b3fa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:54.944421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf2606-3774-44be-9f9d-b20c228c08e4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:54.944848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb6ba-626c-43f3-a3ce-139a26b3fa2b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.945155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb6ba-626c-43f3-a3ce-139a26b3fa2b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.945425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb6ba-626c-43f3-a3ce-139a26b3fa2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.952451 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fb6ba-626c-43f3-a3ce-139a26b3fa2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:54.953945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fb6ba-626c-43f3-a3ce-139a26b3fa2b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-607fb6ba-626c-43f3-a3ce-139a26b3fa2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:44:54.968517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:54.970265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:54.972582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:44:54.972582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:44:54.972582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:44:54.972582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:44:54.972582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:44:54.972582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:44:54.972582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:54.972582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:54.972582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 284/560] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:54.975159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab5b0-1c6f-4594-bf46-c4453f0e67ec None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.975159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab5b0-1c6f-4594-bf46-c4453f0e67ec None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.975159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab5b0-1c6f-4594-bf46-c4453f0e67ec None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.977304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 285/561] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:54.978197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543dc1c-3658-4cf6-b0ed-af8623a74921 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.978604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543dc1c-3658-4cf6-b0ed-af8623a74921 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.979036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543dc1c-3658-4cf6-b0ed-af8623a74921 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.985176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 286/562] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:54.985176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543dc1c-3658-4cf6-b0ed-af8623a74921 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:55.000027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d47187-454d-4427-a0d9-99b31451915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.000696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47187-454d-4427-a0d9-99b31451915d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.000990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47187-454d-4427-a0d9-99b31451915d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.002109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47187-454d-4427-a0d9-99b31451915d None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.002109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d47187-454d-4427-a0d9-99b31451915d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:55.002595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d47187-454d-4427-a0d9-99b31451915d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:55.004001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d47187-454d-4427-a0d9-99b31451915d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:55.031735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 277/563] 10.222.0.55 () {56 vars in 1137 bytes} [Mon Jul 25 22:44:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:44:55.031735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedac18-7a58-473c-a402-d6da8b89ee88 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.031735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedac18-7a58-473c-a402-d6da8b89ee88 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.031735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedac18-7a58-473c-a402-d6da8b89ee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.047565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ecedac18-7a58-473c-a402-d6da8b89ee88 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:55.049543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ecedac18-7a58-473c-a402-d6da8b89ee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:55.109183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:55.116757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543dc1c-3658-4cf6-b0ed-af8623a74921 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:55.139118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 278/564] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:55.140208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124473d9-0aba-428b-bccb-e50b04da8fd0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.140542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124473d9-0aba-428b-bccb-e50b04da8fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.140778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124473d9-0aba-428b-bccb-e50b04da8fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.173919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-124473d9-0aba-428b-bccb-e50b04da8fd0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:55.175664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-124473d9-0aba-428b-bccb-e50b04da8fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:55.181774 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:55.201076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa89cf4-2aeb-4411-b717-ce183f48d923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.201798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa89cf4-2aeb-4411-b717-ce183f48d923 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.202051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa89cf4-2aeb-4411-b717-ce183f48d923 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.202328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa89cf4-2aeb-4411-b717-ce183f48d923 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.203086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa89cf4-2aeb-4411-b717-ce183f48d923 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:55.203393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa89cf4-2aeb-4411-b717-ce183f48d923 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:55.204846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa89cf4-2aeb-4411-b717-ce183f48d923 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:55.219626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 287/565] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:55.220572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa89cf4-2aeb-4411-b717-ce183f48d923 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:55.255931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 279/566] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:55.257138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124473d9-0aba-428b-bccb-e50b04da8fd0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:55.336361 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa89cf4-2aeb-4411-b717-ce183f48d923 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:55.377408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4aadd1-ad06-4416-9b0a-34b2d13315dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.378303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4aadd1-ad06-4416-9b0a-34b2d13315dd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.379202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4aadd1-ad06-4416-9b0a-34b2d13315dd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.379617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4aadd1-ad06-4416-9b0a-34b2d13315dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.381765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124473d9-0aba-428b-bccb-e50b04da8fd0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:55.389889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4aadd1-ad06-4416-9b0a-34b2d13315dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:55.390817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:55.391369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4aadd1-ad06-4416-9b0a-34b2d13315dd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-dd4aadd1-ad06-4416-9b0a-34b2d13315dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:55.406526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:55.407501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:55.413415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:55.413415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:55.413415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:55.413415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:55.413415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 288/567] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:55.413415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4aadd1-ad06-4416-9b0a-34b2d13315dd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:55.420860 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05475f05-1c62-44ae-9409-ddcd36f88c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.421537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475f05-1c62-44ae-9409-ddcd36f88c38 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.421982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475f05-1c62-44ae-9409-ddcd36f88c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.422208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475f05-1c62-44ae-9409-ddcd36f88c38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.435018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05475f05-1c62-44ae-9409-ddcd36f88c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-05475f05-1c62-44ae-9409-ddcd36f88c38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:55.440128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:55.441687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:55.442567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:55.446855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 280/568] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:55.447770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05475f05-1c62-44ae-9409-ddcd36f88c38 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:55.448711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:55.527499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4aadd1-ad06-4416-9b0a-34b2d13315dd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:55.562355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05475f05-1c62-44ae-9409-ddcd36f88c38 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:55.567566 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc62f86-484a-432b-aece-27106d25331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.568279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc62f86-484a-432b-aece-27106d25331a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.568641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc62f86-484a-432b-aece-27106d25331a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.568924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc62f86-484a-432b-aece-27106d25331a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.569753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc62f86-484a-432b-aece-27106d25331a None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=6db67b0bfa2a4c0f84fad07ac144b7bd) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:55.570184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc62f86-484a-432b-aece-27106d25331a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:55.571512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc62f86-484a-432b-aece-27106d25331a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:55.577734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 289/569] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:44:55 2022] GET /identity/v3/role_assignments?user.id=6db67b0bfa2a4c0f84fad07ac144b7bd&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:55.586303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc62f86-484a-432b-aece-27106d25331a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:55.606695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016d1b1-8ba9-44df-b84b-f90c352cdfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.607809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016d1b1-8ba9-44df-b84b-f90c352cdfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.607809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016d1b1-8ba9-44df-b84b-f90c352cdfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.607983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016d1b1-8ba9-44df-b84b-f90c352cdfa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.620513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016d1b1-8ba9-44df-b84b-f90c352cdfa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f016d1b1-8ba9-44df-b84b-f90c352cdfa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:55.626347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:55.627355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:55.628826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 281/570] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:55.630338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016d1b1-8ba9-44df-b84b-f90c352cdfa3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:55.663987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:55.748340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:55.756696 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc62f86-484a-432b-aece-27106d25331a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:55.764825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016d1b1-8ba9-44df-b84b-f90c352cdfa3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:55.802809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7c464-8492-483e-a1a4-ac30c8ecad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.803436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7c464-8492-483e-a1a4-ac30c8ecad08 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.803722 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7c464-8492-483e-a1a4-ac30c8ecad08 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.803999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7c464-8492-483e-a1a4-ac30c8ecad08 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.804702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7c464-8492-483e-a1a4-ac30c8ecad08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:55.805012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7c464-8492-483e-a1a4-ac30c8ecad08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:55.806421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7c464-8492-483e-a1a4-ac30c8ecad08 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:55.812043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1990805-9a17-4ae0-a395-93b994665255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.812962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1990805-9a17-4ae0-a395-93b994665255 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.813518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1990805-9a17-4ae0-a395-93b994665255 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.813791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1990805-9a17-4ae0-a395-93b994665255 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.814520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1990805-9a17-4ae0-a395-93b994665255 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:55.814827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1990805-9a17-4ae0-a395-93b994665255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:55.816732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1990805-9a17-4ae0-a395-93b994665255 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:55.820192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 290/571] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:55.821692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe357f4-8dff-4281-a5de-e3421bb871fb None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.822114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe357f4-8dff-4281-a5de-e3421bb871fb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.822519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe357f4-8dff-4281-a5de-e3421bb871fb None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.823943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 291/572] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:55.824789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe357f4-8dff-4281-a5de-e3421bb871fb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:55.834925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 282/573] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:55.836121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1990805-9a17-4ae0-a395-93b994665255 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:55.944273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:55.947907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe357f4-8dff-4281-a5de-e3421bb871fb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:55.955937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1990805-9a17-4ae0-a395-93b994665255 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:55.988791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06165c-9ffa-4fd0-984a-c10ecb299bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.989835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06165c-9ffa-4fd0-984a-c10ecb299bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.990311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06165c-9ffa-4fd0-984a-c10ecb299bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.990791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06165c-9ffa-4fd0-984a-c10ecb299bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.992080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06165c-9ffa-4fd0-984a-c10ecb299bd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:55.992619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06165c-9ffa-4fd0-984a-c10ecb299bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:55.995157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06165c-9ffa-4fd0-984a-c10ecb299bd2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:55.996420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114173a2-578a-440d-8d98-85b655c86f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.997147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114173a2-578a-440d-8d98-85b655c86f93 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.997498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114173a2-578a-440d-8d98-85b655c86f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.997866 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114173a2-578a-440d-8d98-85b655c86f93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.005110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114173a2-578a-440d-8d98-85b655c86f93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:56.006674 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114173a2-578a-440d-8d98-85b655c86f93 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:56.009423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 292/574] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:56.011487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d2750-ed9d-4bab-a91e-2d7b4d228d2b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.012009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d2750-ed9d-4bab-a91e-2d7b4d228d2b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.012486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d2750-ed9d-4bab-a91e-2d7b4d228d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-114173a2-578a-440d-8d98-85b655c86f93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:44:56.023492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:56.024550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:56.025846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:44:56.025846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:44:56.025846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:44:56.025846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:44:56.025846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:44:56.025846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:44:56.025846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:56.025846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:56.026283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 283/575] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:56.026774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114173a2-578a-440d-8d98-85b655c86f93 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:56.049407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8d6d2750-ed9d-4bab-a91e-2d7b4d228d2b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:56.052049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8d6d2750-ed9d-4bab-a91e-2d7b4d228d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:56.071551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:56.141630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 293/576] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:56.141630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d2750-ed9d-4bab-a91e-2d7b4d228d2b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:56.166932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114173a2-578a-440d-8d98-85b655c86f93 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:56.210374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297c3d7-95a4-48f4-bef6-625d4551346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:56.212281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c3d7-95a4-48f4-bef6-625d4551346b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.212281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c3d7-95a4-48f4-bef6-625d4551346b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.212281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c3d7-95a4-48f4-bef6-625d4551346b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.226831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297c3d7-95a4-48f4-bef6-625d4551346b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:56.228760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297c3d7-95a4-48f4-bef6-625d4551346b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:56.240336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1297c3d7-95a4-48f4-bef6-625d4551346b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:56.249522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:56.254509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:56.255372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:56.255372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:56.255372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:56.255372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:56.255372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 284/577] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:56.255372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297c3d7-95a4-48f4-bef6-625d4551346b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:56.256287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d2750-ed9d-4bab-a91e-2d7b4d228d2b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:56.298871 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f325d5e-4943-487a-9f73-53436d09d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:56.299990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f325d5e-4943-487a-9f73-53436d09d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.300530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f325d5e-4943-487a-9f73-53436d09d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.300867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f325d5e-4943-487a-9f73-53436d09d0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.313230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f325d5e-4943-487a-9f73-53436d09d0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:56.314712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f325d5e-4943-487a-9f73-53436d09d0a8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:56.323969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-0f325d5e-4943-487a-9f73-53436d09d0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:56.334998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:56.342025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:56.342901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:56.342901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:56.342901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:56.342901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:56.342901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 294/578] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:56.342901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f325d5e-4943-487a-9f73-53436d09d0a8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:56.381158 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297c3d7-95a4-48f4-bef6-625d4551346b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:56.416500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661c50c-2c82-4f7c-bd51-86f3ac23a1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:56.417113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661c50c-2c82-4f7c-bd51-86f3ac23a1fb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.417425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661c50c-2c82-4f7c-bd51-86f3ac23a1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.417892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661c50c-2c82-4f7c-bd51-86f3ac23a1fb None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.418653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661c50c-2c82-4f7c-bd51-86f3ac23a1fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:56.418959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661c50c-2c82-4f7c-bd51-86f3ac23a1fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:56.420404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661c50c-2c82-4f7c-bd51-86f3ac23a1fb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:56.438962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 285/579] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:56.438962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661c50c-2c82-4f7c-bd51-86f3ac23a1fb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:56.459264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f325d5e-4943-487a-9f73-53436d09d0a8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:56.496112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da096dd1-92a5-4eab-ac3f-8b02209d8c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:56.496656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da096dd1-92a5-4eab-ac3f-8b02209d8c38 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.496985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da096dd1-92a5-4eab-ac3f-8b02209d8c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.497230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da096dd1-92a5-4eab-ac3f-8b02209d8c38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.500670 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:56.512391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da096dd1-92a5-4eab-ac3f-8b02209d8c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-da096dd1-92a5-4eab-ac3f-8b02209d8c38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:56.521974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:56.523153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 295/580] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:56.524090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da096dd1-92a5-4eab-ac3f-8b02209d8c38 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:56.554674 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661c50c-2c82-4f7c-bd51-86f3ac23a1fb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:56.590301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:56.596594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2529a4f-a9dc-47de-b729-b987c173b452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:56.597247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2529a4f-a9dc-47de-b729-b987c173b452 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.597617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2529a4f-a9dc-47de-b729-b987c173b452 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.597804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2529a4f-a9dc-47de-b729-b987c173b452 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.598596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2529a4f-a9dc-47de-b729-b987c173b452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:56.599169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2529a4f-a9dc-47de-b729-b987c173b452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:56.600294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2529a4f-a9dc-47de-b729-b987c173b452 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:56.617823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 286/581] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:56.617823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2529a4f-a9dc-47de-b729-b987c173b452 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:56.642497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da096dd1-92a5-4eab-ac3f-8b02209d8c38 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:56.686370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6bff9-71d4-4c63-811c-7deda7b2516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:56.687104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6bff9-71d4-4c63-811c-7deda7b2516d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.687388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6bff9-71d4-4c63-811c-7deda7b2516d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.687664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6bff9-71d4-4c63-811c-7deda7b2516d None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.688356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6bff9-71d4-4c63-811c-7deda7b2516d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:56.688662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6bff9-71d4-4c63-811c-7deda7b2516d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:56.690061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6bff9-71d4-4c63-811c-7deda7b2516d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:56.703937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 296/582] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:56.704877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6bff9-71d4-4c63-811c-7deda7b2516d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:56.746448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2529a4f-a9dc-47de-b729-b987c173b452 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:56.768417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:56.783457 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b070d-be61-4387-ac68-ab7c37171fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:56.784136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b070d-be61-4387-ac68-ab7c37171fa9 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.785366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b070d-be61-4387-ac68-ab7c37171fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.785469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b070d-be61-4387-ac68-ab7c37171fa9 None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/a911a544e17e4fafb579da66973c431f/roles/7b381eede31e433d8686d9ffae1da02c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.803674 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b070d-be61-4387-ac68-ab7c37171fa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=a911a544e17e4fafb579da66973c431f, role_id=7b381eede31e433d8686d9ffae1da02c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:56.805194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b070d-be61-4387-ac68-ab7c37171fa9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:56.832604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6bff9-71d4-4c63-811c-7deda7b2516d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:56.855594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:56.879001 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d91f3-5b80-463e-afdc-614ef9de4372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:56.879642 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d91f3-5b80-463e-afdc-614ef9de4372 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.879927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d91f3-5b80-463e-afdc-614ef9de4372 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.880231 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d91f3-5b80-463e-afdc-614ef9de4372 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.880926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d91f3-5b80-463e-afdc-614ef9de4372 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:56.881275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d91f3-5b80-463e-afdc-614ef9de4372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:56.882690 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d91f3-5b80-463e-afdc-614ef9de4372 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:56.897456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 287/583] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:44:56 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/a911a544e17e4fafb579da66973c431f/roles/7b381eede31e433d8686d9ffae1da02c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:56.897456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b070d-be61-4387-ac68-ab7c37171fa9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:56.897760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 297/584] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:56.897760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d91f3-5b80-463e-afdc-614ef9de4372 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:57.062946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b070d-be61-4387-ac68-ab7c37171fa9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:57.093593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d91f3-5b80-463e-afdc-614ef9de4372 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:57.114777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10c3b5-8b92-4e73-9951-07f52b65adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:57.115430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10c3b5-8b92-4e73-9951-07f52b65adb3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:57.115714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10c3b5-8b92-4e73-9951-07f52b65adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:57.119799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10c3b5-8b92-4e73-9951-07f52b65adb3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:57.124234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10c3b5-8b92-4e73-9951-07f52b65adb3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:57.125875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10c3b5-8b92-4e73-9951-07f52b65adb3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:57.137353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd437cb-f3da-48d4-a7f1-213e11eb9039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:57.138102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd437cb-f3da-48d4-a7f1-213e11eb9039 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:57.138448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd437cb-f3da-48d4-a7f1-213e11eb9039 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:57.138784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd437cb-f3da-48d4-a7f1-213e11eb9039 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:57.148075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd437cb-f3da-48d4-a7f1-213e11eb9039 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-9b10c3b5-8b92-4e73-9951-07f52b65adb3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:44:57.148933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:57.150124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:57.151291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:57.151291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:57.151291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:44:57.151291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:44:57.151291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:44:57.151291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:44:57.151291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:44:57.151291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:44:57.151291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:44:57.151291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:57.152449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd437cb-f3da-48d4-a7f1-213e11eb9039 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:57.154067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 288/585] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:44:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:57.155408 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10c3b5-8b92-4e73-9951-07f52b65adb3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5bd437cb-f3da-48d4-a7f1-213e11eb9039 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:44:57.165917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:57.167151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:57.168344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:57.168344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:57.168344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:44:57.168344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:44:57.168344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:44:57.168344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:44:57.168344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:44:57.168344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:44:57.168344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:44:57.168344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:57.170424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 298/586] 10.222.0.55 () {56 vars in 1093 bytes} [Mon Jul 25 22:44:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:57.171097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd437cb-f3da-48d4-a7f1-213e11eb9039 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:57.201278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:57.222768 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:57.280017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10c3b5-8b92-4e73-9951-07f52b65adb3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:57.286540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd437cb-f3da-48d4-a7f1-213e11eb9039 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:57.318637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0073110-c232-4c96-9b20-6984c64d15fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:57.319557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0073110-c232-4c96-9b20-6984c64d15fa None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:57.320036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0073110-c232-4c96-9b20-6984c64d15fa None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:57.320453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0073110-c232-4c96-9b20-6984c64d15fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:57.325356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ab111-d264-44b3-929f-5a34fedf020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:57.326151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ab111-d264-44b3-929f-5a34fedf020d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:57.326517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ab111-d264-44b3-929f-5a34fedf020d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:57.326907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ab111-d264-44b3-929f-5a34fedf020d None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:57.327819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ab111-d264-44b3-929f-5a34fedf020d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:57.328227 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ab111-d264-44b3-929f-5a34fedf020d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:57.329811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ab111-d264-44b3-929f-5a34fedf020d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:57.336045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0073110-c232-4c96-9b20-6984c64d15fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:57.337938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0073110-c232-4c96-9b20-6984c64d15fa None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:57.350330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 299/587] 10.222.0.55 () {56 vars in 1137 bytes} [Mon Jul 25 22:44:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:57.351334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ab111-d264-44b3-929f-5a34fedf020d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b0073110-c232-4c96-9b20-6984c64d15fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:57.356253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:57.357401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:57.358509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:57.358509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:57.358509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:57.358509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:57.360353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 289/588] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:57.361415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0073110-c232-4c96-9b20-6984c64d15fa None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:57.463585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:57.468470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ab111-d264-44b3-929f-5a34fedf020d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:57.477580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:57.488209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0073110-c232-4c96-9b20-6984c64d15fa None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:57.515219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d6b5b-96a5-4e77-95b6-ffb99e73587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:57.516243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d6b5b-96a5-4e77-95b6-ffb99e73587f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:57.516698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d6b5b-96a5-4e77-95b6-ffb99e73587f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:57.517081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d6b5b-96a5-4e77-95b6-ffb99e73587f None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:57.518053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d6b5b-96a5-4e77-95b6-ffb99e73587f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:57.518517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d6b5b-96a5-4e77-95b6-ffb99e73587f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:57.520973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d6b5b-96a5-4e77-95b6-ffb99e73587f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:57.549185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 300/589] 10.222.0.55 () {56 vars in 1133 bytes} [Mon Jul 25 22:44:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:57.549185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d6b5b-96a5-4e77-95b6-ffb99e73587f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:57.572013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fd39a-fe00-47c6-be64-6d2d5470c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:57.573025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd39a-fe00-47c6-be64-6d2d5470c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:57.573538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd39a-fe00-47c6-be64-6d2d5470c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:57.574048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd39a-fe00-47c6-be64-6d2d5470c5d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:57.588144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fd39a-fe00-47c6-be64-6d2d5470c5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:57.590062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fd39a-fe00-47c6-be64-6d2d5470c5d8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-128fd39a-fe00-47c6-be64-6d2d5470c5d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:57.607369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:57.608388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:57.609751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:57.609751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:57.609751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:57.609751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:57.611962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 290/590] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:57.613863 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fd39a-fe00-47c6-be64-6d2d5470c5d8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:57.719293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d6b5b-96a5-4e77-95b6-ffb99e73587f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:57.749979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fd39a-fe00-47c6-be64-6d2d5470c5d8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:57.761609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267029eb-228e-431f-93ea-7129fd18723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:57.762433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267029eb-228e-431f-93ea-7129fd18723c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:57.762807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267029eb-228e-431f-93ea-7129fd18723c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:57.763300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267029eb-228e-431f-93ea-7129fd18723c None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:57.764188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267029eb-228e-431f-93ea-7129fd18723c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:57.764723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267029eb-228e-431f-93ea-7129fd18723c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:57.766438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267029eb-228e-431f-93ea-7129fd18723c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:57.784331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 301/591] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:57.784331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267029eb-228e-431f-93ea-7129fd18723c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:57.799496 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80cb33-27e8-4837-b22d-07d439da10e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:57.800876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80cb33-27e8-4837-b22d-07d439da10e4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:57.802307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80cb33-27e8-4837-b22d-07d439da10e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:57.802574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80cb33-27e8-4837-b22d-07d439da10e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:57.804378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:57.805051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:57.814656 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80cb33-27e8-4837-b22d-07d439da10e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:57.817188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80cb33-27e8-4837-b22d-07d439da10e4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-fe80cb33-27e8-4837-b22d-07d439da10e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:57.833477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:57.839279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:57.840250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:57.840250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:57.840250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:57.840250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:57.840250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 291/592] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:57.840250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea75d1-e583-4a6c-9c25-84feb486bc0e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:57.840250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea75d1-e583-4a6c-9c25-84feb486bc0e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:57.840250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea75d1-e583-4a6c-9c25-84feb486bc0e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:57.840250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 292/593] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:57.840774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea75d1-e583-4a6c-9c25-84feb486bc0e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:57.908567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267029eb-228e-431f-93ea-7129fd18723c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:57.946697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f60241-664a-452d-aefc-0ca2625a1a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:57.947315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60241-664a-452d-aefc-0ca2625a1a6d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:57.947597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60241-664a-452d-aefc-0ca2625a1a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:57.947865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60241-664a-452d-aefc-0ca2625a1a6d None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:57.948548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f60241-664a-452d-aefc-0ca2625a1a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:57.948851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f60241-664a-452d-aefc-0ca2625a1a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:57.952652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f60241-664a-452d-aefc-0ca2625a1a6d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:57.970604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 302/594] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:57.970604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f60241-664a-452d-aefc-0ca2625a1a6d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:57.977788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea75d1-e583-4a6c-9c25-84feb486bc0e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:58.022835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fac9b-27e0-4903-b1ba-a5e8ff1df026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:58.023769 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fac9b-27e0-4903-b1ba-a5e8ff1df026 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:58.024321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fac9b-27e0-4903-b1ba-a5e8ff1df026 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:58.024737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fac9b-27e0-4903-b1ba-a5e8ff1df026 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:58.034437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fac9b-27e0-4903-b1ba-a5e8ff1df026 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:58.037000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fac9b-27e0-4903-b1ba-a5e8ff1df026 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-005fac9b-27e0-4903-b1ba-a5e8ff1df026 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:44:58.050215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:58.052425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:58.053744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:58.053744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:58.053744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:44:58.053744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:44:58.053744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:44:58.053744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:44:58.053744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:44:58.053744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:44:58.053744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:44:58.053744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:58.058430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 293/595] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:58.059710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff5bfd-a3c6-4945-86ad-29ab284fdfb4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:58.059996 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff5bfd-a3c6-4945-86ad-29ab284fdfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:58.060297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff5bfd-a3c6-4945-86ad-29ab284fdfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:58.061893 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:58.080784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-45ff5bfd-a3c6-4945-86ad-29ab284fdfb4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:58.082625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-45ff5bfd-a3c6-4945-86ad-29ab284fdfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:58.089413 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f60241-664a-452d-aefc-0ca2625a1a6d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:58.135136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:58.135953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9b71-730d-4662-9f88-a32b8f55688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:58.137085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9b71-730d-4662-9f88-a32b8f55688f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:58.137476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9b71-730d-4662-9f88-a32b8f55688f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:58.138135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9b71-730d-4662-9f88-a32b8f55688f None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:58.138966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde9b71-730d-4662-9f88-a32b8f55688f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:58.139374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde9b71-730d-4662-9f88-a32b8f55688f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:58.141641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde9b71-730d-4662-9f88-a32b8f55688f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:58.160938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 303/596] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:58.160938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9b71-730d-4662-9f88-a32b8f55688f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:58.168600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 294/597] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:58.173005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff5bfd-a3c6-4945-86ad-29ab284fdfb4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:58.295802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9b71-730d-4662-9f88-a32b8f55688f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:58.317152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff5bfd-a3c6-4945-86ad-29ab284fdfb4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:58.344881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012a72a-7e02-41f6-9f0c-000f3d3648f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:58.345482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012a72a-7e02-41f6-9f0c-000f3d3648f2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:58.345764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012a72a-7e02-41f6-9f0c-000f3d3648f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:58.346050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012a72a-7e02-41f6-9f0c-000f3d3648f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:58.349534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:58.355177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012a72a-7e02-41f6-9f0c-000f3d3648f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:58.356897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012a72a-7e02-41f6-9f0c-000f3d3648f2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a012a72a-7e02-41f6-9f0c-000f3d3648f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:44:58.370964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:58.380533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:58.382013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:44:58.382013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:44:58.382013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:44:58.382013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:44:58.382013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:44:58.382013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:44:58.382013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:58.382013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:58.382454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d7f43-e385-4e70-87e8-92187d7abd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:58.382545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 304/598] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:58.382614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d7f43-e385-4e70-87e8-92187d7abd98 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:58.382614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d7f43-e385-4e70-87e8-92187d7abd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:58.382745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012a72a-7e02-41f6-9f0c-000f3d3648f2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:58.382816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d7f43-e385-4e70-87e8-92187d7abd98 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:58.382816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d7f43-e385-4e70-87e8-92187d7abd98 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:58.382816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d7f43-e385-4e70-87e8-92187d7abd98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:58.382816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d7f43-e385-4e70-87e8-92187d7abd98 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:58.417991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 295/599] 10.222.0.55 () {56 vars in 1139 bytes} [Mon Jul 25 22:44:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:58.418884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d7f43-e385-4e70-87e8-92187d7abd98 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:58.461722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:58.493450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012a72a-7e02-41f6-9f0c-000f3d3648f2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:58.535326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6de22-4efb-46e3-ac9d-91d52f228981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:58.536201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6de22-4efb-46e3-ac9d-91d52f228981 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:58.536338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6de22-4efb-46e3-ac9d-91d52f228981 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:58.536667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6de22-4efb-46e3-ac9d-91d52f228981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:58.545896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6de22-4efb-46e3-ac9d-91d52f228981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:58.546195 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d7f43-e385-4e70-87e8-92187d7abd98 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:58.548238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6de22-4efb-46e3-ac9d-91d52f228981 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4cb6de22-4efb-46e3-ac9d-91d52f228981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:44:58.572534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:58.573965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:58.575625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:44:58.575625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:44:58.575625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:44:58.575625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:44:58.575625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:44:58.575625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:44:58.575625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:58.575625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:58.575625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 305/600] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:58.576536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6de22-4efb-46e3-ac9d-91d52f228981 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:58.595799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a73af5-2836-4363-97df-4c1ce9215b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:58.596259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a73af5-2836-4363-97df-4c1ce9215b29 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:58.596544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a73af5-2836-4363-97df-4c1ce9215b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:58.596821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a73af5-2836-4363-97df-4c1ce9215b29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:58.610568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a73af5-2836-4363-97df-4c1ce9215b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-46a73af5-2836-4363-97df-4c1ce9215b29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:44:58.616353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:58.617636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 296/601] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:44:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:58.618442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a73af5-2836-4363-97df-4c1ce9215b29 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:58.656674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:58.709427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6de22-4efb-46e3-ac9d-91d52f228981 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:58.737165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:58.746205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a73af5-2836-4363-97df-4c1ce9215b29 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:58.748731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf453-895f-4e2d-af81-11e0dd38e8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:58.749605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf453-895f-4e2d-af81-11e0dd38e8cc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:58.749883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf453-895f-4e2d-af81-11e0dd38e8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:58.750209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf453-895f-4e2d-af81-11e0dd38e8cc None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:58.750990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bf453-895f-4e2d-af81-11e0dd38e8cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:58.751469 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bf453-895f-4e2d-af81-11e0dd38e8cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:58.752798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bf453-895f-4e2d-af81-11e0dd38e8cc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:58.772701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 306/602] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:58.772701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf453-895f-4e2d-af81-11e0dd38e8cc None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:58.790593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8526e26-8c55-435f-8b7e-fe2397d76d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:58.791253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526e26-8c55-435f-8b7e-fe2397d76d1b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:58.791537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526e26-8c55-435f-8b7e-fe2397d76d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:58.791816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526e26-8c55-435f-8b7e-fe2397d76d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:58.804424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8526e26-8c55-435f-8b7e-fe2397d76d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:58.805951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8526e26-8c55-435f-8b7e-fe2397d76d1b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b8526e26-8c55-435f-8b7e-fe2397d76d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:58.822219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:58.823337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:58.824271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:58.824271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:58.824271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:58.824271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:44:58.824271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 297/603] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:58.824539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8526e26-8c55-435f-8b7e-fe2397d76d1b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:58.903852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf453-895f-4e2d-af81-11e0dd38e8cc None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:58.923387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:58.944143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07d24-d43a-4650-b0f1-08d9b5a11f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:58.944778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07d24-d43a-4650-b0f1-08d9b5a11f9f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:58.945061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07d24-d43a-4650-b0f1-08d9b5a11f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:58.945388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07d24-d43a-4650-b0f1-08d9b5a11f9f None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:58.946168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc07d24-d43a-4650-b0f1-08d9b5a11f9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:58.946482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc07d24-d43a-4650-b0f1-08d9b5a11f9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:58.948051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc07d24-d43a-4650-b0f1-08d9b5a11f9f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:58.950423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8526e26-8c55-435f-8b7e-fe2397d76d1b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:58.960773 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 307/604] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:58.961640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07d24-d43a-4650-b0f1-08d9b5a11f9f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:59.000918 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c3dbb-ca30-4724-a197-23daa3160b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:59.001595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3dbb-ca30-4724-a197-23daa3160b83 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.001880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3dbb-ca30-4724-a197-23daa3160b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.002147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3dbb-ca30-4724-a197-23daa3160b83 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.002863 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c3dbb-ca30-4724-a197-23daa3160b83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:59.003188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c3dbb-ca30-4724-a197-23daa3160b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:59.005764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c3dbb-ca30-4724-a197-23daa3160b83 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:59.020432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 298/605] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:44:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:59.020432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c3dbb-ca30-4724-a197-23daa3160b83 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:59.030865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:59.083268 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07d24-d43a-4650-b0f1-08d9b5a11f9f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:59.123586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c241f-6c32-443e-b773-12e90f1f1804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:59.124192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c241f-6c32-443e-b773-12e90f1f1804 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.124472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c241f-6c32-443e-b773-12e90f1f1804 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.124749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c241f-6c32-443e-b773-12e90f1f1804 None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/3ccf6c1a5c044294a8eb83c877a6316e/roles/7b381eede31e433d8686d9ffae1da02c` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.142993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c241f-6c32-443e-b773-12e90f1f1804 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=3ccf6c1a5c044294a8eb83c877a6316e, role_id=7b381eede31e433d8686d9ffae1da02c)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:59.143251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c3dbb-ca30-4724-a197-23daa3160b83 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:59.145414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c241f-6c32-443e-b773-12e90f1f1804 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:59.183607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff4fe3-ae2d-43aa-92a6-f5714defc38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:59.184319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff4fe3-ae2d-43aa-92a6-f5714defc38b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.184611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff4fe3-ae2d-43aa-92a6-f5714defc38b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.184892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff4fe3-ae2d-43aa-92a6-f5714defc38b None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.185646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff4fe3-ae2d-43aa-92a6-f5714defc38b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:59.185938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff4fe3-ae2d-43aa-92a6-f5714defc38b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:59.187347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff4fe3-ae2d-43aa-92a6-f5714defc38b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:59.200308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 299/606] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:59.201273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff4fe3-ae2d-43aa-92a6-f5714defc38b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:59.216813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 308/607] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:44:58 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/3ccf6c1a5c044294a8eb83c877a6316e/roles/7b381eede31e433d8686d9ffae1da02c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:59.220072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c241f-6c32-443e-b773-12e90f1f1804 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:59.253061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:59.291403 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:59.340080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff4fe3-ae2d-43aa-92a6-f5714defc38b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:59.356252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c241f-6c32-443e-b773-12e90f1f1804 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:59.397250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d481-f712-43f6-a95d-04fdf46b8637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:59.397250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d481-f712-43f6-a95d-04fdf46b8637 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.397678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d481-f712-43f6-a95d-04fdf46b8637 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.399373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d481-f712-43f6-a95d-04fdf46b8637 None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/eea60163008a4bea95d130a5809fc50d/roles/7b381eede31e433d8686d9ffae1da02c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.415036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbd2aa-fe36-485c-bbb5-1d2838409ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:59.415727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbd2aa-fe36-485c-bbb5-1d2838409ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.416010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbd2aa-fe36-485c-bbb5-1d2838409ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.416285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbd2aa-fe36-485c-bbb5-1d2838409ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.418574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9d481-f712-43f6-a95d-04fdf46b8637 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=eea60163008a4bea95d130a5809fc50d, role_id=7b381eede31e433d8686d9ffae1da02c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:59.420488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9d481-f712-43f6-a95d-04fdf46b8637 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:59.431239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbd2aa-fe36-485c-bbb5-1d2838409ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:59.432731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbd2aa-fe36-485c-bbb5-1d2838409ec1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-9bbbd2aa-fe36-485c-bbb5-1d2838409ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:44:59.449263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:59.453503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:59.454783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:44:59.454783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:44:59.454783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:44:59.454783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:59.454783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 309/608] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:59.454783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e14a3-2bc1-406c-9b66-af11dc81aea7 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.454783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e14a3-2bc1-406c-9b66-af11dc81aea7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.454783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e14a3-2bc1-406c-9b66-af11dc81aea7 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.454783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 310/609] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:59.455311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e14a3-2bc1-406c-9b66-af11dc81aea7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:59.521497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 300/610] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:44:59 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/eea60163008a4bea95d130a5809fc50d/roles/7b381eede31e433d8686d9ffae1da02c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:44:59.522680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d481-f712-43f6-a95d-04fdf46b8637 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:59.565030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:59.596404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e14a3-2bc1-406c-9b66-af11dc81aea7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:59.653603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2fb0e-cde6-46b0-8220-89aaf5d93080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:59.654541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2fb0e-cde6-46b0-8220-89aaf5d93080 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.655172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2fb0e-cde6-46b0-8220-89aaf5d93080 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.655663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2fb0e-cde6-46b0-8220-89aaf5d93080 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.665195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2fb0e-cde6-46b0-8220-89aaf5d93080 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:59.667172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2fb0e-cde6-46b0-8220-89aaf5d93080 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f7a2fb0e-cde6-46b0-8220-89aaf5d93080 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:44:59.682437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:44:59.683573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:44:59.684919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:44:59.684919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:44:59.684919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:44:59.684919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:44:59.684919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:44:59.684919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:44:59.684919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:44:59.684919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:44:59.687915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 311/611] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:44:59.689805 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbfccf-8bc4-430e-93af-43fc27f0832e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.690300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbfccf-8bc4-430e-93af-43fc27f0832e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.690880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbfccf-8bc4-430e-93af-43fc27f0832e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.697176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d481-f712-43f6-a95d-04fdf46b8637 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:59.719687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:59.729908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-24fbfccf-8bc4-430e-93af-43fc27f0832e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:59.732340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-24fbfccf-8bc4-430e-93af-43fc27f0832e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:59.743817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab8dc3-6400-42e7-a456-ff7833efc397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:59.743817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab8dc3-6400-42e7-a456-ff7833efc397 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.744278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab8dc3-6400-42e7-a456-ff7833efc397 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.744671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab8dc3-6400-42e7-a456-ff7833efc397 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.745574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab8dc3-6400-42e7-a456-ff7833efc397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:59.745986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab8dc3-6400-42e7-a456-ff7833efc397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:59.747705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab8dc3-6400-42e7-a456-ff7833efc397 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:59.763396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 301/612] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:44:59.764530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab8dc3-6400-42e7-a456-ff7833efc397 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:59.873192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 312/613] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:44:59.873192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbfccf-8bc4-430e-93af-43fc27f0832e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:59.941607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab8dc3-6400-42e7-a456-ff7833efc397 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:59.971282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:59.986514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdab9a7-5b58-4174-a548-d62c1180d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:59.987638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdab9a7-5b58-4174-a548-d62c1180d9fd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.988155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdab9a7-5b58-4174-a548-d62c1180d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.988647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdab9a7-5b58-4174-a548-d62c1180d9fd None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.994630 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdab9a7-5b58-4174-a548-d62c1180d9fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:44:59.994630 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdab9a7-5b58-4174-a548-d62c1180d9fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:59.994630 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdab9a7-5b58-4174-a548-d62c1180d9fd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:00.006441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 302/614] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:00.007859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdab9a7-5b58-4174-a548-d62c1180d9fd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:00.029742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbfccf-8bc4-430e-93af-43fc27f0832e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:00.060059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:00.086609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aaaac-ae5b-498c-8dd5-924d002edf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:00.087626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aaaac-ae5b-498c-8dd5-924d002edf1b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:00.089352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aaaac-ae5b-498c-8dd5-924d002edf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:00.089765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aaaac-ae5b-498c-8dd5-924d002edf1b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:00.100271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43aaaac-ae5b-498c-8dd5-924d002edf1b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:00.101911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43aaaac-ae5b-498c-8dd5-924d002edf1b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b43aaaac-ae5b-498c-8dd5-924d002edf1b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:00.115970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:00.117172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:00.118353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:00.118353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:00.118353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:00.118353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:00.118353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:00.118353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:00.118353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:00.118353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:00.118353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:45:00.118353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:00.120735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 313/615] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:44:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:00.121768 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aaaac-ae5b-498c-8dd5-924d002edf1b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:00.150601 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdab9a7-5b58-4174-a548-d62c1180d9fd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:00.200047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174f7e-09c6-47e3-949d-3e276c60ec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:00.201218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174f7e-09c6-47e3-949d-3e276c60ec7c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:00.201903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174f7e-09c6-47e3-949d-3e276c60ec7c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:00.202328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174f7e-09c6-47e3-949d-3e276c60ec7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:00.218726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49174f7e-09c6-47e3-949d-3e276c60ec7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-49174f7e-09c6-47e3-949d-3e276c60ec7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:00.225052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:00.226059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:00.226873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:00.233168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 303/616] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:45:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:00.233168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174f7e-09c6-47e3-949d-3e276c60ec7c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:00.259038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aaaac-ae5b-498c-8dd5-924d002edf1b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:00.289878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:00.305036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d693063-b0a7-406c-a677-7a28f66753ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:00.308878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d693063-b0a7-406c-a677-7a28f66753ac None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:00.308878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d693063-b0a7-406c-a677-7a28f66753ac None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:00.308878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d693063-b0a7-406c-a677-7a28f66753ac None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/aa8cd52bd9f24f7d8ed93943aaaeaa9f/roles/7b381eede31e433d8686d9ffae1da02c` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:00.332623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d693063-b0a7-406c-a677-7a28f66753ac None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=aa8cd52bd9f24f7d8ed93943aaaeaa9f, role_id=7b381eede31e433d8686d9ffae1da02c)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:00.334266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d693063-b0a7-406c-a677-7a28f66753ac None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:00.371205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:00.375438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174f7e-09c6-47e3-949d-3e276c60ec7c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:00.410049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 314/617] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:45:00 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/aa8cd52bd9f24f7d8ed93943aaaeaa9f/roles/7b381eede31e433d8686d9ffae1da02c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:45:00.412400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d693063-b0a7-406c-a677-7a28f66753ac None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:00.414479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d18bd-325b-48e4-8c71-b461ca0adf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:00.415148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d18bd-325b-48e4-8c71-b461ca0adf34 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:00.415473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d18bd-325b-48e4-8c71-b461ca0adf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:00.415764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d18bd-325b-48e4-8c71-b461ca0adf34 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:00.416786 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d18bd-325b-48e4-8c71-b461ca0adf34 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:00.417244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d18bd-325b-48e4-8c71-b461ca0adf34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:00.419385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d18bd-325b-48e4-8c71-b461ca0adf34 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:00.464122 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 304/618] 10.222.0.55 () {56 vars in 1135 bytes} [Mon Jul 25 22:45:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:00.469756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d18bd-325b-48e4-8c71-b461ca0adf34 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:00.552934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d693063-b0a7-406c-a677-7a28f66753ac None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:00.597060 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d93c2-585c-478a-96b6-264ac9f61de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:00.598970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d93c2-585c-478a-96b6-264ac9f61de1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:00.599517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d93c2-585c-478a-96b6-264ac9f61de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:00.599992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d93c2-585c-478a-96b6-264ac9f61de1 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:00.601629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d93c2-585c-478a-96b6-264ac9f61de1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:00.602157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d93c2-585c-478a-96b6-264ac9f61de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:00.603878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d93c2-585c-478a-96b6-264ac9f61de1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:00.614925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 315/619] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:45:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:00.622714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d93c2-585c-478a-96b6-264ac9f61de1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:00.693476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:00.712791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d18bd-325b-48e4-8c71-b461ca0adf34 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:00.789692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f74f6c-d1d8-4290-81b6-1a755905f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:00.790353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74f6c-d1d8-4290-81b6-1a755905f3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:00.790635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74f6c-d1d8-4290-81b6-1a755905f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:00.790910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74f6c-d1d8-4290-81b6-1a755905f3e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:00.806010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f74f6c-d1d8-4290-81b6-1a755905f3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:00.807624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f74f6c-d1d8-4290-81b6-1a755905f3e9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:00.821258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d93c2-585c-478a-96b6-264ac9f61de1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-84f74f6c-d1d8-4290-81b6-1a755905f3e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:00.844621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:00.845613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:00.846481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:00.846481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:00.846481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:00.846481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:00.850986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 305/620] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:00.856561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f74f6c-d1d8-4290-81b6-1a755905f3e9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:00.896926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:00.913403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc44c71-0dd1-466b-82f5-d6f65eada5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:00.914466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44c71-0dd1-466b-82f5-d6f65eada5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:00.914962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44c71-0dd1-466b-82f5-d6f65eada5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:00.915452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44c71-0dd1-466b-82f5-d6f65eada5d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:00.940786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc44c71-0dd1-466b-82f5-d6f65eada5d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:00.943016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc44c71-0dd1-466b-82f5-d6f65eada5d6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-bbc44c71-0dd1-466b-82f5-d6f65eada5d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:00.976388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:00.977797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:00.978668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:00.978668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:00.978668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:00.978668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:00.978668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 316/621] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:00.986196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc44c71-0dd1-466b-82f5-d6f65eada5d6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:01.097802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f74f6c-d1d8-4290-81b6-1a755905f3e9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:01.168050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7dcc-e99a-44e6-9b93-8f7dede3c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:01.168688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7dcc-e99a-44e6-9b93-8f7dede3c7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.168967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7dcc-e99a-44e6-9b93-8f7dede3c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.169269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7dcc-e99a-44e6-9b93-8f7dede3c7d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:01.169969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7dcc-e99a-44e6-9b93-8f7dede3c7d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:01.170274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7dcc-e99a-44e6-9b93-8f7dede3c7d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:01.171653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7dcc-e99a-44e6-9b93-8f7dede3c7d1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:01.181515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:01.195183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc44c71-0dd1-466b-82f5-d6f65eada5d6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:01.207039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 306/622] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:01.223510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7dcc-e99a-44e6-9b93-8f7dede3c7d1 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:01.261561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b87e2-7d79-4684-aa96-60d2193c4631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:01.262245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b87e2-7d79-4684-aa96-60d2193c4631 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.262579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b87e2-7d79-4684-aa96-60d2193c4631 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.262857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b87e2-7d79-4684-aa96-60d2193c4631 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:01.263607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b87e2-7d79-4684-aa96-60d2193c4631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:01.263913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b87e2-7d79-4684-aa96-60d2193c4631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:01.265312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b87e2-7d79-4684-aa96-60d2193c4631 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:01.293158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 317/623] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:01.294738 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b87e2-7d79-4684-aa96-60d2193c4631 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:01.347963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:01.451404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7dcc-e99a-44e6-9b93-8f7dede3c7d1 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:01.539007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b87e2-7d79-4684-aa96-60d2193c4631 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:01.548006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cf886-3fdb-4253-8553-ebb4c46ecd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:01.552738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cf886-3fdb-4253-8553-ebb4c46ecd50 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.552738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cf886-3fdb-4253-8553-ebb4c46ecd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.552738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cf886-3fdb-4253-8553-ebb4c46ecd50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:01.560327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93cf886-3fdb-4253-8553-ebb4c46ecd50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:01.562077 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93cf886-3fdb-4253-8553-ebb4c46ecd50 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f93cf886-3fdb-4253-8553-ebb4c46ecd50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:01.574724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:01.575856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:01.576921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:01.576921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:01.576921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:01.576921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:01.576921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:01.576921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:01.576921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:01.576921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:01.583682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 307/624] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:01.585949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f373a28-b5cc-4db5-99d0-9efe8219ecb7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.586241 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f373a28-b5cc-4db5-99d0-9efe8219ecb7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.586619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f373a28-b5cc-4db5-99d0-9efe8219ecb7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:01.588224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d3de7-ebdb-4624-bd1f-3003ca3aee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:01.588482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 308/625] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:01.589271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d3de7-ebdb-4624-bd1f-3003ca3aee1a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.589409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f373a28-b5cc-4db5-99d0-9efe8219ecb7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:01.589919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d3de7-ebdb-4624-bd1f-3003ca3aee1a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.590348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d3de7-ebdb-4624-bd1f-3003ca3aee1a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:01.602917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d3de7-ebdb-4624-bd1f-3003ca3aee1a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:01.604462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d3de7-ebdb-4624-bd1f-3003ca3aee1a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f45d3de7-ebdb-4624-bd1f-3003ca3aee1a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:01.622074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:01.623270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:01.624232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:01.624232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:01.624232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:01.624232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:01.624232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:01.624232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:01.624232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:01.624232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:01.624232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:45:01.624232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:01.626366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 318/626] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:45:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:01.627731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668a83b-2088-47e6-8900-600331e5f63b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.628709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668a83b-2088-47e6-8900-600331e5f63b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.629153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668a83b-2088-47e6-8900-600331e5f63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:01.649416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a668a83b-2088-47e6-8900-600331e5f63b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:01.650975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a668a83b-2088-47e6-8900-600331e5f63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:01.664409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:01.737214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 319/627] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:45:01.739420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668a83b-2088-47e6-8900-600331e5f63b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:01.775377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f373a28-b5cc-4db5-99d0-9efe8219ecb7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:01.807039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:01.815166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6af34-55d2-438e-9894-7fbf7e6a7325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:01.816540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6af34-55d2-438e-9894-7fbf7e6a7325 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.817018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6af34-55d2-438e-9894-7fbf7e6a7325 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.820619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6af34-55d2-438e-9894-7fbf7e6a7325 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:01.820619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6af34-55d2-438e-9894-7fbf7e6a7325 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:01.820619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6af34-55d2-438e-9894-7fbf7e6a7325 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:01.820619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6af34-55d2-438e-9894-7fbf7e6a7325 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:01.835039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 309/628] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:01.836271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6af34-55d2-438e-9894-7fbf7e6a7325 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:01.888664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668a83b-2088-47e6-8900-600331e5f63b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:01.929051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7e4de-3d6c-4b7e-87f9-10037ff7d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:01.929961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e4de-3d6c-4b7e-87f9-10037ff7d81a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.930428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e4de-3d6c-4b7e-87f9-10037ff7d81a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.930954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e4de-3d6c-4b7e-87f9-10037ff7d81a None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:01.931919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7e4de-3d6c-4b7e-87f9-10037ff7d81a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:01.932484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7e4de-3d6c-4b7e-87f9-10037ff7d81a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:01.934130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7e4de-3d6c-4b7e-87f9-10037ff7d81a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:01.951004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:01.956991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 320/629] 10.222.0.55 () {56 vars in 1137 bytes} [Mon Jul 25 22:45:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:01.957932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6af34-55d2-438e-9894-7fbf7e6a7325 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:01.958318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7e4de-3d6c-4b7e-87f9-10037ff7d81a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:01.996975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0392ff-798a-4dae-8e8f-d6ee6674cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:01.997712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0392ff-798a-4dae-8e8f-d6ee6674cc33 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.997992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0392ff-798a-4dae-8e8f-d6ee6674cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.998267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0392ff-798a-4dae-8e8f-d6ee6674cc33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.010812 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0392ff-798a-4dae-8e8f-d6ee6674cc33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-9a0392ff-798a-4dae-8e8f-d6ee6674cc33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:02.015673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:02.016618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 310/630] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:02.018663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0392ff-798a-4dae-8e8f-d6ee6674cc33 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:02.076092 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:02.092160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7e4de-3d6c-4b7e-87f9-10037ff7d81a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:02.139863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce8c03-14b0-4489-b7ef-a9bdd5e6a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:02.140561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce8c03-14b0-4489-b7ef-a9bdd5e6a7fc None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.140848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce8c03-14b0-4489-b7ef-a9bdd5e6a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.141140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce8c03-14b0-4489-b7ef-a9bdd5e6a7fc None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/6db67b0bfa2a4c0f84fad07ac144b7bd/roles/7b381eede31e433d8686d9ffae1da02c` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.156560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0392ff-798a-4dae-8e8f-d6ee6674cc33 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:02.158922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce8c03-14b0-4489-b7ef-a9bdd5e6a7fc None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=6db67b0bfa2a4c0f84fad07ac144b7bd, role_id=7b381eede31e433d8686d9ffae1da02c)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:02.160753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce8c03-14b0-4489-b7ef-a9bdd5e6a7fc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:02.200024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21871ff-4e64-4a37-9c3c-ed53a7060a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:02.200653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21871ff-4e64-4a37-9c3c-ed53a7060a43 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.200928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21871ff-4e64-4a37-9c3c-ed53a7060a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.201230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21871ff-4e64-4a37-9c3c-ed53a7060a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.230418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 321/631] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:45:01 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/6db67b0bfa2a4c0f84fad07ac144b7bd/roles/7b381eede31e433d8686d9ffae1da02c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:45:02.232274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3a37-8632-4417-aa7a-2ceb274e48e1 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.232486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3a37-8632-4417-aa7a-2ceb274e48e1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.232860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3a37-8632-4417-aa7a-2ceb274e48e1 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.240479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 322/632] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:02.240479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d3a37-8632-4417-aa7a-2ceb274e48e1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:02.308190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:02.327253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21871ff-4e64-4a37-9c3c-ed53a7060a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:02.329372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21871ff-4e64-4a37-9c3c-ed53a7060a43 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:02.399857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d3a37-8632-4417-aa7a-2ceb274e48e1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:02.402211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:02.468912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d284d7-4670-4732-9903-71ecf1a3451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:02.471384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d284d7-4670-4732-9903-71ecf1a3451f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.472962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d284d7-4670-4732-9903-71ecf1a3451f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.474188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d284d7-4670-4732-9903-71ecf1a3451f None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.477091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d284d7-4670-4732-9903-71ecf1a3451f None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:02.478311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d284d7-4670-4732-9903-71ecf1a3451f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:02.483035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d284d7-4670-4732-9903-71ecf1a3451f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:02.486600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 311/633] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:45:02.493151 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3fd26-627c-4931-9edb-3abee8f71a2f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.493151 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3fd26-627c-4931-9edb-3abee8f71a2f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.493151 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3fd26-627c-4931-9edb-3abee8f71a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.505504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 323/634] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:45:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:02.506274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d284d7-4670-4732-9903-71ecf1a3451f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:02.528671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-dec3fd26-627c-4931-9edb-3abee8f71a2f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:02.531472 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-dec3fd26-627c-4931-9edb-3abee8f71a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:02.633635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d284d7-4670-4732-9903-71ecf1a3451f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:02.653504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:02.669320 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 312/635] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:45:02.670297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3fd26-627c-4931-9edb-3abee8f71a2f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:02.683901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919833ee-b4e6-4b72-b553-bfa6fcbdb2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:02.685350 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919833ee-b4e6-4b72-b553-bfa6fcbdb2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.686135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919833ee-b4e6-4b72-b553-bfa6fcbdb2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.686977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919833ee-b4e6-4b72-b553-bfa6fcbdb2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.700106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919833ee-b4e6-4b72-b553-bfa6fcbdb2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:02.701112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919833ee-b4e6-4b72-b553-bfa6fcbdb2a7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-919833ee-b4e6-4b72-b553-bfa6fcbdb2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:02.718499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:02.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:02.720362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:02.720362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:02.720362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:02.720362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:02.720362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 324/636] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:02.720949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e246-a2f6-4b17-88d4-cce1a6d369bf None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.721259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e246-a2f6-4b17-88d4-cce1a6d369bf None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.721537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e246-a2f6-4b17-88d4-cce1a6d369bf None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.727501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 325/637] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:02.728309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33e246-a2f6-4b17-88d4-cce1a6d369bf None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:02.779532 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:02.813802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3fd26-627c-4931-9edb-3abee8f71a2f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:02.857459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940dddd-b814-4118-b258-2788cad21458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:02.858326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940dddd-b814-4118-b258-2788cad21458 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.858619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940dddd-b814-4118-b258-2788cad21458 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.858901 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940dddd-b814-4118-b258-2788cad21458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.871675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33e246-a2f6-4b17-88d4-cce1a6d369bf None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:02.872058 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940dddd-b814-4118-b258-2788cad21458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:02.873636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940dddd-b814-4118-b258-2788cad21458 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7940dddd-b814-4118-b258-2788cad21458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:02.890807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:02.891867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:02.892880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:02.892880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:02.892880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:02.892880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:02.892880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 313/638] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:02.893193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940dddd-b814-4118-b258-2788cad21458 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:02.919306 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf6d1a-4a29-4645-a419-a09be715b073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:02.919894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6d1a-4a29-4645-a419-a09be715b073 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.920173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6d1a-4a29-4645-a419-a09be715b073 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.920446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6d1a-4a29-4645-a419-a09be715b073 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.933868 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf6d1a-4a29-4645-a419-a09be715b073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b1bf6d1a-4a29-4645-a419-a09be715b073 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:02.939400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:02.941339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:02.942209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 326/639] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:45:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:02.942898 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4a25-b2ed-425d-a5e3-b5eac197865d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.943146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4a25-b2ed-425d-a5e3-b5eac197865d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.944287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4a25-b2ed-425d-a5e3-b5eac197865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.964575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-364d4a25-b2ed-425d-a5e3-b5eac197865d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:02.966502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-364d4a25-b2ed-425d-a5e3-b5eac197865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:02.991223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:03.031540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940dddd-b814-4118-b258-2788cad21458 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:03.064611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 327/640] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:45:03.065938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4a25-b2ed-425d-a5e3-b5eac197865d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:03.077509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:03.084320 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65743e34-997c-4536-a0e7-598e8580f6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:03.087853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743e34-997c-4536-a0e7-598e8580f6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:03.087853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743e34-997c-4536-a0e7-598e8580f6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:03.087853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743e34-997c-4536-a0e7-598e8580f6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:03.087853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65743e34-997c-4536-a0e7-598e8580f6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:03.087853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65743e34-997c-4536-a0e7-598e8580f6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:03.088311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65743e34-997c-4536-a0e7-598e8580f6b7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:03.107756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 314/641] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:03.108835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65743e34-997c-4536-a0e7-598e8580f6b7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:03.205182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4a25-b2ed-425d-a5e3-b5eac197865d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:03.229805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65743e34-997c-4536-a0e7-598e8580f6b7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:03.244142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175c2e9-fd95-46d4-b95d-451a31635e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:03.244767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175c2e9-fd95-46d4-b95d-451a31635e84 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:03.245048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175c2e9-fd95-46d4-b95d-451a31635e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:03.245346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175c2e9-fd95-46d4-b95d-451a31635e84 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:03.246044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175c2e9-fd95-46d4-b95d-451a31635e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:03.246343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175c2e9-fd95-46d4-b95d-451a31635e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:03.247716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175c2e9-fd95-46d4-b95d-451a31635e84 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:03.264482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 328/642] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:03.264482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175c2e9-fd95-46d4-b95d-451a31635e84 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:03.272556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d218978-02ab-4caf-89ea-16f785e7e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:03.273316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d218978-02ab-4caf-89ea-16f785e7e134 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:03.273673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d218978-02ab-4caf-89ea-16f785e7e134 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:03.274045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d218978-02ab-4caf-89ea-16f785e7e134 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:03.274773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d218978-02ab-4caf-89ea-16f785e7e134 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:03.275078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d218978-02ab-4caf-89ea-16f785e7e134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:03.276458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d218978-02ab-4caf-89ea-16f785e7e134 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:03.279421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:03.290189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 315/643] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:45:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:03.290189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d218978-02ab-4caf-89ea-16f785e7e134 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:03.364165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:03.393967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175c2e9-fd95-46d4-b95d-451a31635e84 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:03.421278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d218978-02ab-4caf-89ea-16f785e7e134 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:03.438091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160adb39-928c-4a71-ab54-27f105bcd1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:03.438858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160adb39-928c-4a71-ab54-27f105bcd1df None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:03.439149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160adb39-928c-4a71-ab54-27f105bcd1df None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:03.439429 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160adb39-928c-4a71-ab54-27f105bcd1df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:03.448466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160adb39-928c-4a71-ab54-27f105bcd1df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:03.449979 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160adb39-928c-4a71-ab54-27f105bcd1df None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:03.462003 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12832b63-54bc-4bea-9fd6-9ab2fbd1bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:03.462570 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832b63-54bc-4bea-9fd6-9ab2fbd1bd38 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-160adb39-928c-4a71-ab54-27f105bcd1df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:03.462787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:03.463816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:03.464714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:03.464714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:03.464714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:03.464714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:03.464714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:03.464714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:03.464714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:03.464714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:03.465184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832b63-54bc-4bea-9fd6-9ab2fbd1bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:03.465184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832b63-54bc-4bea-9fd6-9ab2fbd1bd38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:03.465317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 329/644] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:03.465317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160adb39-928c-4a71-ab54-27f105bcd1df None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:03.480945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12832b63-54bc-4bea-9fd6-9ab2fbd1bd38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-12832b63-54bc-4bea-9fd6-9ab2fbd1bd38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:03.486577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:03.487582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 316/645] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:45:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:03.493832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12832b63-54bc-4bea-9fd6-9ab2fbd1bd38 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:03.556953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:03.585820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160adb39-928c-4a71-ab54-27f105bcd1df None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:03.610586 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12832b63-54bc-4bea-9fd6-9ab2fbd1bd38 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:03.622546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347fc0b-e699-4d14-a6c7-c43279664548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:03.623195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347fc0b-e699-4d14-a6c7-c43279664548 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:03.623478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347fc0b-e699-4d14-a6c7-c43279664548 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:03.623749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347fc0b-e699-4d14-a6c7-c43279664548 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:03.624957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:03.632885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347fc0b-e699-4d14-a6c7-c43279664548 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:03.634393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347fc0b-e699-4d14-a6c7-c43279664548 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7347fc0b-e699-4d14-a6c7-c43279664548 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:03.647190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:03.648398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:03.649719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:03.649719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:03.649719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:03.649719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:03.649719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:03.649719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:03.649719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:03.649719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:03.649719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:45:03.649719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:03.650387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb6c8d-6902-43c3-bc66-865616790086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:03.650387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb6c8d-6902-43c3-bc66-865616790086 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:03.650387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb6c8d-6902-43c3-bc66-865616790086 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:03.650625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb6c8d-6902-43c3-bc66-865616790086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:03.651989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 330/646] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:45:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:03.652947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347fc0b-e699-4d14-a6c7-c43279664548 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:03.670819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb6c8d-6902-43c3-bc66-865616790086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:03.672380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb6c8d-6902-43c3-bc66-865616790086 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-61bb6c8d-6902-43c3-bc66-865616790086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:03.688548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:03.689571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:03.690486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:03.690486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:03.690486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:03.690486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:03.690486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 317/647] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:03.691544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb6c8d-6902-43c3-bc66-865616790086 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:03.774418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347fc0b-e699-4d14-a6c7-c43279664548 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:03.813656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318babb0-80c4-4d8d-82a8-86eb665518b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:03.814282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318babb0-80c4-4d8d-82a8-86eb665518b7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:03.814563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318babb0-80c4-4d8d-82a8-86eb665518b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:03.814852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318babb0-80c4-4d8d-82a8-86eb665518b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:03.816577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318babb0-80c4-4d8d-82a8-86eb665518b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:03.816903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318babb0-80c4-4d8d-82a8-86eb665518b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:03.818411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318babb0-80c4-4d8d-82a8-86eb665518b7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:03.819982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb6c8d-6902-43c3-bc66-865616790086 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:03.820273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:03.840036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 331/648] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:03.840036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318babb0-80c4-4d8d-82a8-86eb665518b7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:03.878626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33491c55-0c58-4aa1-bb1f-c7f4ba550e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:03.879665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33491c55-0c58-4aa1-bb1f-c7f4ba550e24 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:03.880007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33491c55-0c58-4aa1-bb1f-c7f4ba550e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:03.880352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33491c55-0c58-4aa1-bb1f-c7f4ba550e24 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:03.881176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33491c55-0c58-4aa1-bb1f-c7f4ba550e24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:03.881492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33491c55-0c58-4aa1-bb1f-c7f4ba550e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:03.882891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33491c55-0c58-4aa1-bb1f-c7f4ba550e24 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:03.896791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 318/649] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:45:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:03.896791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33491c55-0c58-4aa1-bb1f-c7f4ba550e24 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:03.928278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:03.950520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318babb0-80c4-4d8d-82a8-86eb665518b7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:03.990731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ab6f8-ffdb-4de4-9d97-da059a833a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:03.991385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ab6f8-ffdb-4de4-9d97-da059a833a26 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:03.991670 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ab6f8-ffdb-4de4-9d97-da059a833a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:03.991942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ab6f8-ffdb-4de4-9d97-da059a833a26 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:03.992750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ab6f8-ffdb-4de4-9d97-da059a833a26 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:03.993053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ab6f8-ffdb-4de4-9d97-da059a833a26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:03.994528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ab6f8-ffdb-4de4-9d97-da059a833a26 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:04.011527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33491c55-0c58-4aa1-bb1f-c7f4ba550e24 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:04.018435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 332/650] 10.222.0.55 () {56 vars in 1137 bytes} [Mon Jul 25 22:45:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:04.018435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ab6f8-ffdb-4de4-9d97-da059a833a26 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:04.063136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa591ac-2b13-4d4e-934f-4f93f1445fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:04.064233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa591ac-2b13-4d4e-934f-4f93f1445fef None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.064531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa591ac-2b13-4d4e-934f-4f93f1445fef None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.064830 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa591ac-2b13-4d4e-934f-4f93f1445fef None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.066057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa591ac-2b13-4d4e-934f-4f93f1445fef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:04.067280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa591ac-2b13-4d4e-934f-4f93f1445fef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:04.069362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa591ac-2b13-4d4e-934f-4f93f1445fef None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:04.078831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:04.085105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 319/651] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:04.086324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa591ac-2b13-4d4e-934f-4f93f1445fef None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:04.140219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ab6f8-ffdb-4de4-9d97-da059a833a26 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:04.179248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280164e0-505a-4f22-88c9-2ea1f97d3f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:04.179871 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280164e0-505a-4f22-88c9-2ea1f97d3f45 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.180160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280164e0-505a-4f22-88c9-2ea1f97d3f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.180435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280164e0-505a-4f22-88c9-2ea1f97d3f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.181266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280164e0-505a-4f22-88c9-2ea1f97d3f45 None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=a911a544e17e4fafb579da66973c431f) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:04.181579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280164e0-505a-4f22-88c9-2ea1f97d3f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:04.183028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280164e0-505a-4f22-88c9-2ea1f97d3f45 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:04.184402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:04.201159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 333/652] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:04 2022] GET /identity/v3/role_assignments?user.id=a911a544e17e4fafb579da66973c431f&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:04.201159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280164e0-505a-4f22-88c9-2ea1f97d3f45 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:04.216353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa591ac-2b13-4d4e-934f-4f93f1445fef None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:04.260938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78eca9-b34b-447d-8bf1-2000ec48d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:04.261862 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78eca9-b34b-447d-8bf1-2000ec48d9ff None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.262215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78eca9-b34b-447d-8bf1-2000ec48d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.262557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78eca9-b34b-447d-8bf1-2000ec48d9ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.276480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78eca9-b34b-447d-8bf1-2000ec48d9ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:04.278535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78eca9-b34b-447d-8bf1-2000ec48d9ff None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1a78eca9-b34b-447d-8bf1-2000ec48d9ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:04.297425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:04.298404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:04.299284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:04.299284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:04.299284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:04.299284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:04.304665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 320/653] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:04.306298 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78eca9-b34b-447d-8bf1-2000ec48d9ff None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:04.319444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280164e0-505a-4f22-88c9-2ea1f97d3f45 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:04.348319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:04.380058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44553be1-de18-4d36-baf5-2f1c7133cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:04.381646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44553be1-de18-4d36-baf5-2f1c7133cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.382150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44553be1-de18-4d36-baf5-2f1c7133cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.382821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44553be1-de18-4d36-baf5-2f1c7133cbe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.451501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78eca9-b34b-447d-8bf1-2000ec48d9ff None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:04.485101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44553be1-de18-4d36-baf5-2f1c7133cbe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:04.486702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44553be1-de18-4d36-baf5-2f1c7133cbe4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:04.493485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d2996-3853-4c23-86c0-6fb453f03de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:04.494141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2996-3853-4c23-86c0-6fb453f03de7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.494423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2996-3853-4c23-86c0-6fb453f03de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.494722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2996-3853-4c23-86c0-6fb453f03de7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.503780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d2996-3853-4c23-86c0-6fb453f03de7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:04.505665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d2996-3853-4c23-86c0-6fb453f03de7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:04.507901 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-188d2996-3853-4c23-86c0-6fb453f03de7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:04.525225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:04.542966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 321/654] 10.222.0.55 () {56 vars in 1093 bytes} [Mon Jul 25 22:45:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:04.543902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d2996-3853-4c23-86c0-6fb453f03de7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:04.624737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 334/655] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:45:04.626420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c7f41-b2ba-41d9-af85-f41b57eae716 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.626776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c7f41-b2ba-41d9-af85-f41b57eae716 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.627124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c7f41-b2ba-41d9-af85-f41b57eae716 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.629628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 335/656] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:04.630297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c7f41-b2ba-41d9-af85-f41b57eae716 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:04.652138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:04.665247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d2996-3853-4c23-86c0-6fb453f03de7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:04.705817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3959aa-2eae-4ae0-9595-4e06d58ca1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:04.708016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3959aa-2eae-4ae0-9595-4e06d58ca1fd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.708016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3959aa-2eae-4ae0-9595-4e06d58ca1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.708016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3959aa-2eae-4ae0-9595-4e06d58ca1fd None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.708849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3959aa-2eae-4ae0-9595-4e06d58ca1fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:04.709174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3959aa-2eae-4ae0-9595-4e06d58ca1fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:04.710663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3959aa-2eae-4ae0-9595-4e06d58ca1fd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:04.728829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 322/657] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:04.729680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3959aa-2eae-4ae0-9595-4e06d58ca1fd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:04.759999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c7f41-b2ba-41d9-af85-f41b57eae716 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:04.797447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:04.802183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210b30e-9fde-46ca-b3e0-eb8766c0eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:04.802817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210b30e-9fde-46ca-b3e0-eb8766c0eca7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.803099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210b30e-9fde-46ca-b3e0-eb8766c0eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.803374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210b30e-9fde-46ca-b3e0-eb8766c0eca7 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.804273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210b30e-9fde-46ca-b3e0-eb8766c0eca7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:04.804581 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210b30e-9fde-46ca-b3e0-eb8766c0eca7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:04.806082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210b30e-9fde-46ca-b3e0-eb8766c0eca7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:04.825987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 336/658] 10.222.0.55 () {56 vars in 1133 bytes} [Mon Jul 25 22:45:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:04.832402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0edc6-3fb0-4012-9733-273685cd8429 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.832671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0edc6-3fb0-4012-9733-273685cd8429 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.833019 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0edc6-3fb0-4012-9733-273685cd8429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.850559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3959aa-2eae-4ae0-9595-4e06d58ca1fd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:04.861541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-14c0edc6-3fb0-4012-9733-273685cd8429 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:04.864201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-14c0edc6-3fb0-4012-9733-273685cd8429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:04.892541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654c4b9-7c39-4ed4-b31f-e087c580cc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:04.893112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654c4b9-7c39-4ed4-b31f-e087c580cc6a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.893454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654c4b9-7c39-4ed4-b31f-e087c580cc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.893828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654c4b9-7c39-4ed4-b31f-e087c580cc6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.905530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654c4b9-7c39-4ed4-b31f-e087c580cc6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:04.907009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654c4b9-7c39-4ed4-b31f-e087c580cc6a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-0654c4b9-7c39-4ed4-b31f-e087c580cc6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:04.922374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:04.924209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:04.926701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:04.926701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:04.926701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:04.926701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:04.926701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 323/659] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:04.926701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654c4b9-7c39-4ed4-b31f-e087c580cc6a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:04.981469 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 337/660] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:45:04.982506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0edc6-3fb0-4012-9733-273685cd8429 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:04.987034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.064878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654c4b9-7c39-4ed4-b31f-e087c580cc6a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:05.077542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.108402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e501c-e4ea-4e99-90b3-26d3b6959e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:05.108788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0edc6-3fb0-4012-9733-273685cd8429 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:05.109071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e501c-e4ea-4e99-90b3-26d3b6959e30 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.109440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e501c-e4ea-4e99-90b3-26d3b6959e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.109677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e501c-e4ea-4e99-90b3-26d3b6959e30 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.123825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e501c-e4ea-4e99-90b3-26d3b6959e30 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:05.126693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e501c-e4ea-4e99-90b3-26d3b6959e30 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-c51e501c-e4ea-4e99-90b3-26d3b6959e30 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:05.142927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:05.145292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 324/661] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:45:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:05.146698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e501c-e4ea-4e99-90b3-26d3b6959e30 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:05.159346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6c2d-9a9b-4857-adb9-1cea2463e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:05.161731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6c2d-9a9b-4857-adb9-1cea2463e5ae None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.162149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6c2d-9a9b-4857-adb9-1cea2463e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.162551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6c2d-9a9b-4857-adb9-1cea2463e5ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.250390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf6c2d-9a9b-4857-adb9-1cea2463e5ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:05.253289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf6c2d-9a9b-4857-adb9-1cea2463e5ae None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:05.258680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.271918 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e501c-e4ea-4e99-90b3-26d3b6959e30 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:05.316204 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac8d8-ea69-463d-a0a5-e51fca80f2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:05.317824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac8d8-ea69-463d-a0a5-e51fca80f2bd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.318243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac8d8-ea69-463d-a0a5-e51fca80f2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.318562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac8d8-ea69-463d-a0a5-e51fca80f2bd None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.319323 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ac8d8-ea69-463d-a0a5-e51fca80f2bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:05.319669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ac8d8-ea69-463d-a0a5-e51fca80f2bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:05.321607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ac8d8-ea69-463d-a0a5-e51fca80f2bd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:05.343425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 325/662] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:05.343425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac8d8-ea69-463d-a0a5-e51fca80f2bd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:05.373676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.421460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 338/663] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:45:05.423026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6c2d-9a9b-4857-adb9-1cea2463e5ae None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:05.476388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac8d8-ea69-463d-a0a5-e51fca80f2bd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:05.517702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f001ef-cc62-4518-af40-e5d5bd32a594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:05.518370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f001ef-cc62-4518-af40-e5d5bd32a594 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.518746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f001ef-cc62-4518-af40-e5d5bd32a594 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.519474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f001ef-cc62-4518-af40-e5d5bd32a594 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.532546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f001ef-cc62-4518-af40-e5d5bd32a594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b1f001ef-cc62-4518-af40-e5d5bd32a594 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:05.537924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:05.539043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 326/664] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:45:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:05.540282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f001ef-cc62-4518-af40-e5d5bd32a594 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:05.556440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6c2d-9a9b-4857-adb9-1cea2463e5ae None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:05.560376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.605434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf84b32-9b37-4dda-9845-25f5594aa6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:05.606074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf84b32-9b37-4dda-9845-25f5594aa6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.606359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf84b32-9b37-4dda-9845-25f5594aa6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.607211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf84b32-9b37-4dda-9845-25f5594aa6b2 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.608038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf84b32-9b37-4dda-9845-25f5594aa6b2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:05.608367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf84b32-9b37-4dda-9845-25f5594aa6b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:05.609841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf84b32-9b37-4dda-9845-25f5594aa6b2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:05.635791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 339/665] 10.222.0.55 () {56 vars in 1139 bytes} [Mon Jul 25 22:45:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:05.636665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf84b32-9b37-4dda-9845-25f5594aa6b2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:05.662739 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.695138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f001ef-cc62-4518-af40-e5d5bd32a594 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:05.719820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044621-5cfc-4abf-9bb0-a106eff0593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:05.720863 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044621-5cfc-4abf-9bb0-a106eff0593c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.721388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044621-5cfc-4abf-9bb0-a106eff0593c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.721662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044621-5cfc-4abf-9bb0-a106eff0593c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.731037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e044621-5cfc-4abf-9bb0-a106eff0593c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:05.733040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e044621-5cfc-4abf-9bb0-a106eff0593c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-4e044621-5cfc-4abf-9bb0-a106eff0593c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:05.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:05.747526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:05.748391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:05.748391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:05.748391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:05.748391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:05.748391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:05.748391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:05.748391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:05.748391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:05.748391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 327/666] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:05.748865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044621-5cfc-4abf-9bb0-a106eff0593c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:05.758930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf84b32-9b37-4dda-9845-25f5594aa6b2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:05.811191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa12acf-a1aa-4263-8fcf-c94b375c83f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:05.812007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa12acf-a1aa-4263-8fcf-c94b375c83f1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.812283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa12acf-a1aa-4263-8fcf-c94b375c83f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.812552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa12acf-a1aa-4263-8fcf-c94b375c83f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.826272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa12acf-a1aa-4263-8fcf-c94b375c83f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:05.827929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa12acf-a1aa-4263-8fcf-c94b375c83f1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-dfa12acf-a1aa-4263-8fcf-c94b375c83f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:05.843927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:05.845062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:05.846353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:05.846353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:05.846353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:05.846353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:05.847675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 340/667] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:05.848411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa12acf-a1aa-4263-8fcf-c94b375c83f1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:05.873802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.887887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044621-5cfc-4abf-9bb0-a106eff0593c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:05.931807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb168d-a55a-4f35-b3ca-bfb9b8cbe7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:05.932430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb168d-a55a-4f35-b3ca-bfb9b8cbe7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.932704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb168d-a55a-4f35-b3ca-bfb9b8cbe7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.932977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb168d-a55a-4f35-b3ca-bfb9b8cbe7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.933749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb168d-a55a-4f35-b3ca-bfb9b8cbe7f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:05.934053 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb168d-a55a-4f35-b3ca-bfb9b8cbe7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:05.935446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb168d-a55a-4f35-b3ca-bfb9b8cbe7f2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:05.950244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 328/668] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:45:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:05.950244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb168d-a55a-4f35-b3ca-bfb9b8cbe7f2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:05.964945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.983665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa12acf-a1aa-4263-8fcf-c94b375c83f1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:06.023097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e68bc-75b9-4ec7-acb2-2b273cafb0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:06.023741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e68bc-75b9-4ec7-acb2-2b273cafb0eb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.024185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e68bc-75b9-4ec7-acb2-2b273cafb0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.024299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e68bc-75b9-4ec7-acb2-2b273cafb0eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.067032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb168d-a55a-4f35-b3ca-bfb9b8cbe7f2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:06.110172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e68bc-75b9-4ec7-acb2-2b273cafb0eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:06.111933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e68bc-75b9-4ec7-acb2-2b273cafb0eb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:06.120984 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4037c-4197-4956-b245-d9b4230a8c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:06.121688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4037c-4197-4956-b245-d9b4230a8c38 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.121971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4037c-4197-4956-b245-d9b4230a8c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.122292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4037c-4197-4956-b245-d9b4230a8c38 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.123101 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4037c-4197-4956-b245-d9b4230a8c38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:06.123410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4037c-4197-4956-b245-d9b4230a8c38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:06.125064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4037c-4197-4956-b245-d9b4230a8c38 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:06.142191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 329/669] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:06.142191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4037c-4197-4956-b245-d9b4230a8c38 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:06.147731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:06.244042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:06.278651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4037c-4197-4956-b245-d9b4230a8c38 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:06.285196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 341/670] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:45:06.285196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e68bc-75b9-4ec7-acb2-2b273cafb0eb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:06.326047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e30494-e193-4aa3-8e95-0f9494f9e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:06.327478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e30494-e193-4aa3-8e95-0f9494f9e8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.327950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e30494-e193-4aa3-8e95-0f9494f9e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.328435 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e30494-e193-4aa3-8e95-0f9494f9e8a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.329708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e30494-e193-4aa3-8e95-0f9494f9e8a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:06.331132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e30494-e193-4aa3-8e95-0f9494f9e8a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:06.332802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e30494-e193-4aa3-8e95-0f9494f9e8a4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:06.355022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 330/671] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:06.355758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e30494-e193-4aa3-8e95-0f9494f9e8a4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:06.416786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e68bc-75b9-4ec7-acb2-2b273cafb0eb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:06.434125 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:06.465008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f590-026d-40ef-8189-74b3b348c1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:06.465841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f590-026d-40ef-8189-74b3b348c1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.466132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f590-026d-40ef-8189-74b3b348c1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.466408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f590-026d-40ef-8189-74b3b348c1c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.478285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22f590-026d-40ef-8189-74b3b348c1c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:06.479045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e30494-e193-4aa3-8e95-0f9494f9e8a4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:06.479853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22f590-026d-40ef-8189-74b3b348c1c0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-6e22f590-026d-40ef-8189-74b3b348c1c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:06.496279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:06.498364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:06.500426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:06.500426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:06.500426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:06.500426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:06.500426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 342/672] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:06.500426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f590-026d-40ef-8189-74b3b348c1c0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:06.514350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:06.520775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9afa68-8e98-44ee-84e2-fd9ac2559e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:06.521434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9afa68-8e98-44ee-84e2-fd9ac2559e7b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.521817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9afa68-8e98-44ee-84e2-fd9ac2559e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.528371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9afa68-8e98-44ee-84e2-fd9ac2559e7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.528371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9afa68-8e98-44ee-84e2-fd9ac2559e7b None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=3ccf6c1a5c044294a8eb83c877a6316e) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:06.528371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9afa68-8e98-44ee-84e2-fd9ac2559e7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:06.528371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9afa68-8e98-44ee-84e2-fd9ac2559e7b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:06.531505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 331/673] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:06 2022] GET /identity/v3/role_assignments?user.id=3ccf6c1a5c044294a8eb83c877a6316e&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:06.532386 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9afa68-8e98-44ee-84e2-fd9ac2559e7b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:06.647393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f590-026d-40ef-8189-74b3b348c1c0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:06.685032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9afa68-8e98-44ee-84e2-fd9ac2559e7b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:06.692642 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b7c78-b520-4ddf-82cb-a2390df1b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:06.693327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b7c78-b520-4ddf-82cb-a2390df1b587 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.693610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b7c78-b520-4ddf-82cb-a2390df1b587 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.693879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b7c78-b520-4ddf-82cb-a2390df1b587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.707522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b7c78-b520-4ddf-82cb-a2390df1b587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:06.708941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b7c78-b520-4ddf-82cb-a2390df1b587 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-720b7c78-b520-4ddf-82cb-a2390df1b587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:06.726811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:06.727845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:06.729092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:06.729092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:06.729092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:06.729092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:06.729092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 343/674] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:06.729708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18f019-ceee-4ab2-a4fb-9f0a2fecc286 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.729992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18f019-ceee-4ab2-a4fb-9f0a2fecc286 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.730266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18f019-ceee-4ab2-a4fb-9f0a2fecc286 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.731594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 344/675] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:06.732415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18f019-ceee-4ab2-a4fb-9f0a2fecc286 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:06.736394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac1770-cac7-440c-8add-b9c3a1c43cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:06.737075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac1770-cac7-440c-8add-b9c3a1c43cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.737875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac1770-cac7-440c-8add-b9c3a1c43cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.738229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac1770-cac7-440c-8add-b9c3a1c43cb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.752182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac1770-cac7-440c-8add-b9c3a1c43cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:06.752182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac1770-cac7-440c-8add-b9c3a1c43cb8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:06.762184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-87ac1770-cac7-440c-8add-b9c3a1c43cb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:06.771469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:06.778031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:06.779152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:06.779152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:06.779152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:06.779152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:06.779152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:06.779152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:06.779152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:06.779152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:06.779152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 332/676] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:06.779152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac1770-cac7-440c-8add-b9c3a1c43cb8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:06.873389 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:06.882193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18f019-ceee-4ab2-a4fb-9f0a2fecc286 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:06.933926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00289c-9fb4-41ec-af8b-9c5ac8bcfd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:06.934891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00289c-9fb4-41ec-af8b-9c5ac8bcfd38 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.935175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00289c-9fb4-41ec-af8b-9c5ac8bcfd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.935717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00289c-9fb4-41ec-af8b-9c5ac8bcfd38 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.936489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00289c-9fb4-41ec-af8b-9c5ac8bcfd38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:06.936796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00289c-9fb4-41ec-af8b-9c5ac8bcfd38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:06.937468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac1770-cac7-440c-8add-b9c3a1c43cb8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:06.938231 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00289c-9fb4-41ec-af8b-9c5ac8bcfd38 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:06.957340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 345/677] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:06.958665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b2d82-02c0-4aa1-bf97-8ae3e9319255 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.958952 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b2d82-02c0-4aa1-bf97-8ae3e9319255 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.959223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b2d82-02c0-4aa1-bf97-8ae3e9319255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.985910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-dd2b2d82-02c0-4aa1-bf97-8ae3e9319255 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:06.987146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-dd2b2d82-02c0-4aa1-bf97-8ae3e9319255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:06.990182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf364-71f8-48a4-804f-52d3e1037fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:06.990821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf364-71f8-48a4-804f-52d3e1037fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.991108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf364-71f8-48a4-804f-52d3e1037fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.991385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf364-71f8-48a4-804f-52d3e1037fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.992144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cf364-71f8-48a4-804f-52d3e1037fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:06.992497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cf364-71f8-48a4-804f-52d3e1037fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:06.994048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cf364-71f8-48a4-804f-52d3e1037fa8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:07.009234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 333/678] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:07.010002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf364-71f8-48a4-804f-52d3e1037fa8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:07.085201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 346/679] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:45:07.085201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b2d82-02c0-4aa1-bf97-8ae3e9319255 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:07.100127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:07.159124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf364-71f8-48a4-804f-52d3e1037fa8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:07.180130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:07.198529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5ab79-bb9d-4087-a1dc-7d6e0dc7f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:07.199151 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ab79-bb9d-4087-a1dc-7d6e0dc7f9aa None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:07.199547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ab79-bb9d-4087-a1dc-7d6e0dc7f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:07.199828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ab79-bb9d-4087-a1dc-7d6e0dc7f9aa None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:07.200588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5ab79-bb9d-4087-a1dc-7d6e0dc7f9aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:07.200898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5ab79-bb9d-4087-a1dc-7d6e0dc7f9aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:07.202416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5ab79-bb9d-4087-a1dc-7d6e0dc7f9aa None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:07.210041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b2d82-02c0-4aa1-bf97-8ae3e9319255 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:07.215755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 334/680] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:07.221692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5ab79-bb9d-4087-a1dc-7d6e0dc7f9aa None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:07.248607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb7960-6595-448a-92ec-34f6155094ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:07.249301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb7960-6595-448a-92ec-34f6155094ed None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:07.249584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb7960-6595-448a-92ec-34f6155094ed None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:07.249856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb7960-6595-448a-92ec-34f6155094ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:07.257869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb7960-6595-448a-92ec-34f6155094ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:07.259401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb7960-6595-448a-92ec-34f6155094ed None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f2fb7960-6595-448a-92ec-34f6155094ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:07.272477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:07.273568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 347/681] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:45:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:07.274501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb7960-6595-448a-92ec-34f6155094ed None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:07.340274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5ab79-bb9d-4087-a1dc-7d6e0dc7f9aa None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:07.353784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:07.381041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fda6a-670b-4f25-ade2-2fe56c606336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:07.381846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fda6a-670b-4f25-ade2-2fe56c606336 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:07.382135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fda6a-670b-4f25-ade2-2fe56c606336 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:07.382410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fda6a-670b-4f25-ade2-2fe56c606336 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:07.390100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fda6a-670b-4f25-ade2-2fe56c606336 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:07.391568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fda6a-670b-4f25-ade2-2fe56c606336 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:07.392588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb7960-6595-448a-92ec-34f6155094ed None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b54fda6a-670b-4f25-ade2-2fe56c606336 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:07.405050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:07.406051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:07.407007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:07.407007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:07.407007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:07.407007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:07.407007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:07.407007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:07.407007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:07.407007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:07.407007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 335/682] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:07.407498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fda6a-670b-4f25-ade2-2fe56c606336 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:07.439392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b61bb-94b6-464e-b17e-81162562bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:07.440077 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b61bb-94b6-464e-b17e-81162562bf5c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:07.440381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b61bb-94b6-464e-b17e-81162562bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:07.441263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b61bb-94b6-464e-b17e-81162562bf5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:07.451816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:07.453416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b61bb-94b6-464e-b17e-81162562bf5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:07.454913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b61bb-94b6-464e-b17e-81162562bf5c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4c9b61bb-94b6-464e-b17e-81162562bf5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:07.471189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:07.472894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:07.473835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:07.473835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:07.473835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:07.473835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:07.477579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 348/683] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:07.478846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b61bb-94b6-464e-b17e-81162562bf5c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:07.533651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fda6a-670b-4f25-ade2-2fe56c606336 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:07.575735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec3d40-dd68-446b-a45a-6240e5ca5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:07.576641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec3d40-dd68-446b-a45a-6240e5ca5e55 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:07.576960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec3d40-dd68-446b-a45a-6240e5ca5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:07.577356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec3d40-dd68-446b-a45a-6240e5ca5e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:07.578292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec3d40-dd68-446b-a45a-6240e5ca5e55 None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=eea60163008a4bea95d130a5809fc50d) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:07.578660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec3d40-dd68-446b-a45a-6240e5ca5e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:07.580236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec3d40-dd68-446b-a45a-6240e5ca5e55 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:07.601216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 336/684] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:07 2022] GET /identity/v3/role_assignments?user.id=eea60163008a4bea95d130a5809fc50d&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:07.601216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec3d40-dd68-446b-a45a-6240e5ca5e55 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:07.612027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b61bb-94b6-464e-b17e-81162562bf5c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:07.638313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:07.658162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032ca93-ff2d-40c7-a995-4dd0546448c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:07.659040 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032ca93-ff2d-40c7-a995-4dd0546448c7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:07.660027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032ca93-ff2d-40c7-a995-4dd0546448c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:07.660379 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032ca93-ff2d-40c7-a995-4dd0546448c7 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:07.661396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032ca93-ff2d-40c7-a995-4dd0546448c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:07.661807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032ca93-ff2d-40c7-a995-4dd0546448c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:07.663385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032ca93-ff2d-40c7-a995-4dd0546448c7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:07.697794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 349/685] 10.222.0.55 () {56 vars in 1135 bytes} [Mon Jul 25 22:45:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:07.699807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032ca93-ff2d-40c7-a995-4dd0546448c7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:07.728596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:07.732273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec3d40-dd68-446b-a45a-6240e5ca5e55 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:07.785996 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb9c3a-3bac-4884-a73f-2e56b89cd2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:07.786819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb9c3a-3bac-4884-a73f-2e56b89cd2bd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:07.787176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb9c3a-3bac-4884-a73f-2e56b89cd2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:07.787393 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb9c3a-3bac-4884-a73f-2e56b89cd2bd None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:07.788216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb9c3a-3bac-4884-a73f-2e56b89cd2bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:07.788516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb9c3a-3bac-4884-a73f-2e56b89cd2bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:07.790678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb9c3a-3bac-4884-a73f-2e56b89cd2bd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:07.808333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 337/686] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:07.809926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb9c3a-3bac-4884-a73f-2e56b89cd2bd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:07.880049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032ca93-ff2d-40c7-a995-4dd0546448c7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:07.937546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1cb9b-bf7f-44f3-b049-ad3265ac2f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:07.938191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1cb9b-bf7f-44f3-b049-ad3265ac2f2e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:07.938478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1cb9b-bf7f-44f3-b049-ad3265ac2f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:07.938758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1cb9b-bf7f-44f3-b049-ad3265ac2f2e None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:07.939479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1cb9b-bf7f-44f3-b049-ad3265ac2f2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:07.939786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1cb9b-bf7f-44f3-b049-ad3265ac2f2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:07.941309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1cb9b-bf7f-44f3-b049-ad3265ac2f2e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:07.955416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 350/687] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:07.957703 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1cb9b-bf7f-44f3-b049-ad3265ac2f2e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:07.987851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb9c3a-3bac-4884-a73f-2e56b89cd2bd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:08.015909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:08.074663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56943-d33e-4c8b-bfd1-6bd22a1168f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:08.076681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56943-d33e-4c8b-bfd1-6bd22a1168f5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.077615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56943-d33e-4c8b-bfd1-6bd22a1168f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.079720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56943-d33e-4c8b-bfd1-6bd22a1168f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.088456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1cb9b-bf7f-44f3-b049-ad3265ac2f2e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:08.129040 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8600dfe-3c46-428e-bc9b-afe5426d9e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:08.129728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8600dfe-3c46-428e-bc9b-afe5426d9e92 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.130010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8600dfe-3c46-428e-bc9b-afe5426d9e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.130291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8600dfe-3c46-428e-bc9b-afe5426d9e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.131111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8600dfe-3c46-428e-bc9b-afe5426d9e92 None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=aa8cd52bd9f24f7d8ed93943aaaeaa9f) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:08.131538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8600dfe-3c46-428e-bc9b-afe5426d9e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:08.132999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8600dfe-3c46-428e-bc9b-afe5426d9e92 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:08.140242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 351/688] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:07 2022] GET /identity/v3/role_assignments?user.id=aa8cd52bd9f24f7d8ed93943aaaeaa9f&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:08.141191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8600dfe-3c46-428e-bc9b-afe5426d9e92 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:08.153872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:08.245708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba56943-d33e-4c8b-bfd1-6bd22a1168f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:08.247211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba56943-d33e-4c8b-bfd1-6bd22a1168f5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:08.393535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8600dfe-3c46-428e-bc9b-afe5426d9e92 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:08.396813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:08.454893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 338/689] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:45:08.455671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06c88-c7f9-46d0-ad92-13c85cdf3d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:08.458008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06c88-c7f9-46d0-ad92-13c85cdf3d6b None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.458008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06c88-c7f9-46d0-ad92-13c85cdf3d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.458008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06c88-c7f9-46d0-ad92-13c85cdf3d6b None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.458529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06c88-c7f9-46d0-ad92-13c85cdf3d6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:08.460886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06c88-c7f9-46d0-ad92-13c85cdf3d6b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:08.463599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56943-d33e-4c8b-bfd1-6bd22a1168f5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:08.545100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:08.576251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 352/690] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:45:08 2022] POST /identity/v3/users => generated 254 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:08.608897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56943-d33e-4c8b-bfd1-6bd22a1168f5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:08.665834 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5c016-840f-439f-8519-faa1cf8f2f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:08.666846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5c016-840f-439f-8519-faa1cf8f2f8e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.667336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5c016-840f-439f-8519-faa1cf8f2f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.667826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5c016-840f-439f-8519-faa1cf8f2f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.693855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5c016-840f-439f-8519-faa1cf8f2f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:08.695459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5c016-840f-439f-8519-faa1cf8f2f8e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-28c5c016-840f-439f-8519-faa1cf8f2f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:08.720061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:08.721040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:08.723211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:08.723211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:08.723211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:08.723211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:08.723211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 339/691] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:08.727657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06c88-c7f9-46d0-ad92-13c85cdf3d6b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:08.754430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d88dd-8b7a-4d79-9085-8d2c944b21a6 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.754757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d88dd-8b7a-4d79-9085-8d2c944b21a6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.754991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d88dd-8b7a-4d79-9085-8d2c944b21a6 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.757273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 340/692] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:08.762646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e80a41-03d6-45fd-ba1a-5363ebfb58cf None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.762982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e80a41-03d6-45fd-ba1a-5363ebfb58cf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.763322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e80a41-03d6-45fd-ba1a-5363ebfb58cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.802787 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a9e80a41-03d6-45fd-ba1a-5363ebfb58cf None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:08.804042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a9e80a41-03d6-45fd-ba1a-5363ebfb58cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:08.908771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 341/693] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:45:08.918744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06c88-c7f9-46d0-ad92-13c85cdf3d6b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:08.931961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e80a41-03d6-45fd-ba1a-5363ebfb58cf None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:08.951981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424881d-bb33-445b-8a01-2256bbb7df97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:08.952707 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424881d-bb33-445b-8a01-2256bbb7df97 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.952910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424881d-bb33-445b-8a01-2256bbb7df97 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.953600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424881d-bb33-445b-8a01-2256bbb7df97 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.953872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424881d-bb33-445b-8a01-2256bbb7df97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:08.954180 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424881d-bb33-445b-8a01-2256bbb7df97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:08.955545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424881d-bb33-445b-8a01-2256bbb7df97 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:08.970461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 353/694] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:08.979532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424881d-bb33-445b-8a01-2256bbb7df97 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:09.005905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:09.017500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:09.100269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e80a41-03d6-45fd-ba1a-5363ebfb58cf None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:09.125103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424881d-bb33-445b-8a01-2256bbb7df97 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:09.194374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad015ce-d503-4f1d-9a53-a3405cace3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:09.195404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad015ce-d503-4f1d-9a53-a3405cace3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:09.195904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad015ce-d503-4f1d-9a53-a3405cace3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:09.196397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad015ce-d503-4f1d-9a53-a3405cace3e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:09.197297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad015ce-d503-4f1d-9a53-a3405cace3e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:09.199101 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad015ce-d503-4f1d-9a53-a3405cace3e7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1ad015ce-d503-4f1d-9a53-a3405cace3e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:09.225698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:09.226756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:45:09.227624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:09.239801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 342/695] 10.222.0.55 () {56 vars in 1129 bytes} [Mon Jul 25 22:45:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:09.247617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad015ce-d503-4f1d-9a53-a3405cace3e7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:09.344494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3aa62-e200-474b-aa5b-22a92ca25ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:09.344884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3aa62-e200-474b-aa5b-22a92ca25ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:09.345196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3aa62-e200-474b-aa5b-22a92ca25ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:09.345479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3aa62-e200-474b-aa5b-22a92ca25ad1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:09.362024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3aa62-e200-474b-aa5b-22a92ca25ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:09.364153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3aa62-e200-474b-aa5b-22a92ca25ad1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:09.398501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad015ce-d503-4f1d-9a53-a3405cace3e7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b8c3aa62-e200-474b-aa5b-22a92ca25ad1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:09.399689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:09.400556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:09.401823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:09.401823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:09.401823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:09.401823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:09.401823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:09.401823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:09.401823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:09.401823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:09.401823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 354/696] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:09.408009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3aa62-e200-474b-aa5b-22a92ca25ad1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:09.442874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c38e47-3b96-412f-98a7-43e29aa77111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:09.443938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c38e47-3b96-412f-98a7-43e29aa77111 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:09.444476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c38e47-3b96-412f-98a7-43e29aa77111 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:09.444952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c38e47-3b96-412f-98a7-43e29aa77111 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:09.445892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c38e47-3b96-412f-98a7-43e29aa77111 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:09.446432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c38e47-3b96-412f-98a7-43e29aa77111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:09.448121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c38e47-3b96-412f-98a7-43e29aa77111 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:09.454018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 343/697] 10.222.0.55 () {56 vars in 1124 bytes} [Mon Jul 25 22:45:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:09.465202 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:09.467067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c38e47-3b96-412f-98a7-43e29aa77111 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:09.600712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:09.623428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3aa62-e200-474b-aa5b-22a92ca25ad1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:09.662401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9ee2-e9f5-493c-93fc-322d38cecd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:09.663036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9ee2-e9f5-493c-93fc-322d38cecd80 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:09.663315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9ee2-e9f5-493c-93fc-322d38cecd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:09.663584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9ee2-e9f5-493c-93fc-322d38cecd80 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:09.664412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9ee2-e9f5-493c-93fc-322d38cecd80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:09.664722 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9ee2-e9f5-493c-93fc-322d38cecd80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:09.666206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9ee2-e9f5-493c-93fc-322d38cecd80 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:09.684324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 355/698] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:09.685792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9ee2-e9f5-493c-93fc-322d38cecd80 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:09.762821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c38e47-3b96-412f-98a7-43e29aa77111 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:09.793665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9ee2-e9f5-493c-93fc-322d38cecd80 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:09.839724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15465fb-f8e6-4261-911e-318ca8e8e363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:09.840361 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15465fb-f8e6-4261-911e-318ca8e8e363 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:09.840641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15465fb-f8e6-4261-911e-318ca8e8e363 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:09.840917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15465fb-f8e6-4261-911e-318ca8e8e363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:09.841745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15465fb-f8e6-4261-911e-318ca8e8e363 None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=6db67b0bfa2a4c0f84fad07ac144b7bd) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:09.842136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15465fb-f8e6-4261-911e-318ca8e8e363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:09.843590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15465fb-f8e6-4261-911e-318ca8e8e363 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:09.857276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 356/699] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:09 2022] GET /identity/v3/role_assignments?user.id=6db67b0bfa2a4c0f84fad07ac144b7bd&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:09.892460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f65f5a-916a-49bc-9b3d-ea95e2768e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:09.893473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f65f5a-916a-49bc-9b3d-ea95e2768e7f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:09.894494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f65f5a-916a-49bc-9b3d-ea95e2768e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:09.894957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f65f5a-916a-49bc-9b3d-ea95e2768e7f None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:09.896128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f65f5a-916a-49bc-9b3d-ea95e2768e7f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:09.896643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f65f5a-916a-49bc-9b3d-ea95e2768e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:09.899126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f65f5a-916a-49bc-9b3d-ea95e2768e7f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:09.915878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 344/700] 10.222.0.55 () {56 vars in 1124 bytes} [Mon Jul 25 22:45:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:10.413279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683290d-2df4-4a8f-9265-750da5d7d3bb None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:10.413747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683290d-2df4-4a8f-9265-750da5d7d3bb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:10.414029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683290d-2df4-4a8f-9265-750da5d7d3bb None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:10.415394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 357/701] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:10.423636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355abac-d1b5-41ff-a7a2-eadf8458dd2b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:10.424098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355abac-d1b5-41ff-a7a2-eadf8458dd2b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:10.424567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355abac-d1b5-41ff-a7a2-eadf8458dd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:10.455164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c355abac-d1b5-41ff-a7a2-eadf8458dd2b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:10.457832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c355abac-d1b5-41ff-a7a2-eadf8458dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:10.506801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:10.579410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 345/702] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 25 22:45:10.619784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683290d-2df4-4a8f-9265-750da5d7d3bb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:10.624244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:10.804718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683290d-2df4-4a8f-9265-750da5d7d3bb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:10.880459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c511dcb-0f5c-4891-af7e-2489b76d643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:10.881557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c511dcb-0f5c-4891-af7e-2489b76d643d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:10.882038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c511dcb-0f5c-4891-af7e-2489b76d643d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:10.882516 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c511dcb-0f5c-4891-af7e-2489b76d643d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:10.900730 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c511dcb-0f5c-4891-af7e-2489b76d643d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-3c511dcb-0f5c-4891-af7e-2489b76d643d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:10.910649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:10.911592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:10.912436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:10.913449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 358/703] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:10.927714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355abac-d1b5-41ff-a7a2-eadf8458dd2b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:11.123498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7272e-63dc-4a06-a927-b54059818583 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.123875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7272e-63dc-4a06-a927-b54059818583 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.124056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7272e-63dc-4a06-a927-b54059818583 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.126877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 359/704] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:11.132643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f4c43-8394-4000-a91a-d58abf2a31ea None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.133134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f4c43-8394-4000-a91a-d58abf2a31ea None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.133608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f4c43-8394-4000-a91a-d58abf2a31ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.156611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355abac-d1b5-41ff-a7a2-eadf8458dd2b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:11.163420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e11f4c43-8394-4000-a91a-d58abf2a31ea None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:11.165458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e11f4c43-8394-4000-a91a-d58abf2a31ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:11.258503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f79c8-5e93-48b5-867b-9c486f444ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:11.259524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f79c8-5e93-48b5-867b-9c486f444ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.260013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f79c8-5e93-48b5-867b-9c486f444ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.260498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f79c8-5e93-48b5-867b-9c486f444ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.263349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f79c8-5e93-48b5-867b-9c486f444ed7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:11.267227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f79c8-5e93-48b5-867b-9c486f444ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:11.270316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f79c8-5e93-48b5-867b-9c486f444ed7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:11.300303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 346/705] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:11.306210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f79c8-5e93-48b5-867b-9c486f444ed7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:11.333924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:11.353822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 360/706] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:45:11.360431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:11.397851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f4c43-8394-4000-a91a-d58abf2a31ea None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:11.526878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f79c8-5e93-48b5-867b-9c486f444ed7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:11.568312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f4c43-8394-4000-a91a-d58abf2a31ea None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:11.571693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d832e6-87e2-413b-87a5-7129bef338f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:11.572641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d832e6-87e2-413b-87a5-7129bef338f2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.573186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d832e6-87e2-413b-87a5-7129bef338f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.573664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d832e6-87e2-413b-87a5-7129bef338f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.587561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d832e6-87e2-413b-87a5-7129bef338f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:11.589547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d832e6-87e2-413b-87a5-7129bef338f2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f8d832e6-87e2-413b-87a5-7129bef338f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:11.606178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:11.607145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:11.608038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:11.608038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:11.608038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:11.608038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:11.610404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 347/707] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:11.622395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d832e6-87e2-413b-87a5-7129bef338f2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:11.638660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cb6af-e73c-4a37-b0b2-e30319dd77ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:11.640024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb6af-e73c-4a37-b0b2-e30319dd77ea None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.640499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb6af-e73c-4a37-b0b2-e30319dd77ea None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.640964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb6af-e73c-4a37-b0b2-e30319dd77ea None admin] PATH_INFO: `/v3/services/network` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.641845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cb6af-e73c-4a37-b0b2-e30319dd77ea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:11.643433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cb6af-e73c-4a37-b0b2-e30319dd77ea None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-332cb6af-e73c-4a37-b0b2-e30319dd77ea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:11.660836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:11.661879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:45:11.662704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:11.672232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 361/708] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:11 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:11.679110 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cb6af-e73c-4a37-b0b2-e30319dd77ea None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:11.766207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:11.797479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:11.812692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d832e6-87e2-413b-87a5-7129bef338f2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:11.879845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce227f5b-38b2-4bc7-904a-37e133318bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:11.880483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce227f5b-38b2-4bc7-904a-37e133318bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.880768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce227f5b-38b2-4bc7-904a-37e133318bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.881253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce227f5b-38b2-4bc7-904a-37e133318bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.882368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce227f5b-38b2-4bc7-904a-37e133318bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:11.882687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce227f5b-38b2-4bc7-904a-37e133318bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:11.884549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce227f5b-38b2-4bc7-904a-37e133318bc1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:11.892250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cb6af-e73c-4a37-b0b2-e30319dd77ea None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:11.902015 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 348/709] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:11.903463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5a28-d62c-4486-9178-a699e5551943 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.903758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5a28-d62c-4486-9178-a699e5551943 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.904036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5a28-d62c-4486-9178-a699e5551943 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.905620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 349/710] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:11.907163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf5a28-d62c-4486-9178-a699e5551943 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:11.946920 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d9cd4-150a-4372-a94f-d6195056cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:11.947730 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9cd4-150a-4372-a94f-d6195056cf21 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.948013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9cd4-150a-4372-a94f-d6195056cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.948450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9cd4-150a-4372-a94f-d6195056cf21 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.949536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d9cd4-150a-4372-a94f-d6195056cf21 None admin] RBAC: Adding query filter params (name=network) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:11.950138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d9cd4-150a-4372-a94f-d6195056cf21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:11.951870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d9cd4-150a-4372-a94f-d6195056cf21 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:11.959262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 362/711] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:11.964962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73e775-83bd-4cff-99d2-da7bfbe2cdd8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.965325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73e775-83bd-4cff-99d2-da7bfbe2cdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.965608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73e775-83bd-4cff-99d2-da7bfbe2cdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.989513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-bc73e775-83bd-4cff-99d2-da7bfbe2cdd8 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:11.991000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bc73e775-83bd-4cff-99d2-da7bfbe2cdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:12.045690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf5a28-d62c-4486-9178-a699e5551943 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:12.079807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 363/712] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:45:12.086301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73e775-83bd-4cff-99d2-da7bfbe2cdd8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:12.100462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec20d-5244-472d-b1db-391f111abdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:12.101207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec20d-5244-472d-b1db-391f111abdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:12.101498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec20d-5244-472d-b1db-391f111abdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:12.101829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec20d-5244-472d-b1db-391f111abdd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:12.122598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ec20d-5244-472d-b1db-391f111abdd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:12.124265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ec20d-5244-472d-b1db-391f111abdd6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:12.126442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:12.153408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:12.214946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73e775-83bd-4cff-99d2-da7bfbe2cdd8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:12.257318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f8186-bf77-4190-a4a9-86a1d9193943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:12.257968 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f8186-bf77-4190-a4a9-86a1d9193943 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:12.258316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f8186-bf77-4190-a4a9-86a1d9193943 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:12.258600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f8186-bf77-4190-a4a9-86a1d9193943 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:12.259305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f8186-bf77-4190-a4a9-86a1d9193943 None admin] RBAC: Adding query filter params (type=network) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:12.259616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f8186-bf77-4190-a4a9-86a1d9193943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:12.261637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f8186-bf77-4190-a4a9-86a1d9193943 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-843ec20d-5244-472d-b1db-391f111abdd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:12.266273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:12.267364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:12.268381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:12.268381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:12.268381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:12.268381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:12.268381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:12.268381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:12.268381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:12.268381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:12.268381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:45:12.268381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:12.275614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 364/714] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:12.275614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f8186-bf77-4190-a4a9-86a1d9193943 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:12.276002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 350/714] 10.222.0.55 () {56 vars in 1093 bytes} [Mon Jul 25 22:45:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:12.277230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec20d-5244-472d-b1db-391f111abdd6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:12.477723 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec20d-5244-472d-b1db-391f111abdd6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:12.495157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f8186-bf77-4190-a4a9-86a1d9193943 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:12.510858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:12.522391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce731b4f-3a44-4e10-ae22-7bac8e566afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:12.524316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731b4f-3a44-4e10-ae22-7bac8e566afb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:12.524316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731b4f-3a44-4e10-ae22-7bac8e566afb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:12.524316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731b4f-3a44-4e10-ae22-7bac8e566afb None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:12.526214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce731b4f-3a44-4e10-ae22-7bac8e566afb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:12.526704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce731b4f-3a44-4e10-ae22-7bac8e566afb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:12.528776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce731b4f-3a44-4e10-ae22-7bac8e566afb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:12.538777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e799f-4100-45fc-bb28-98590ef7d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:12.539630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e799f-4100-45fc-bb28-98590ef7d0aa None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:12.539935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e799f-4100-45fc-bb28-98590ef7d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:12.540217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e799f-4100-45fc-bb28-98590ef7d0aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:12.553942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e799f-4100-45fc-bb28-98590ef7d0aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b95e799f-4100-45fc-bb28-98590ef7d0aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:12.559070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:12.560364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:12.561520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:12.566006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 365/715] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:12.567651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e799f-4100-45fc-bb28-98590ef7d0aa None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:12.575783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 351/716] 10.222.0.55 () {56 vars in 1133 bytes} [Mon Jul 25 22:45:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:12.584005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756a92-32f5-40fd-b671-4606300a3085 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:12.584607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756a92-32f5-40fd-b671-4606300a3085 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:12.585020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756a92-32f5-40fd-b671-4606300a3085 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:12.588078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 352/717] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:12.589210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61756a92-32f5-40fd-b671-4606300a3085 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:12.676645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:12.685747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e799f-4100-45fc-bb28-98590ef7d0aa None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:12.738106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61756a92-32f5-40fd-b671-4606300a3085 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:12.738568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feda71-31f8-41b0-be5d-138c9f46104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:12.739387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feda71-31f8-41b0-be5d-138c9f46104e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:12.740162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feda71-31f8-41b0-be5d-138c9f46104e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:12.741392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feda71-31f8-41b0-be5d-138c9f46104e None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:12.742123 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feda71-31f8-41b0-be5d-138c9f46104e None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:12.742438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feda71-31f8-41b0-be5d-138c9f46104e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:12.746594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feda71-31f8-41b0-be5d-138c9f46104e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:12.759156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 366/718] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:12.760989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cbd0f-80fa-49c8-9cb7-d3d635da0198 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:12.761527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cbd0f-80fa-49c8-9cb7-d3d635da0198 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:12.762036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cbd0f-80fa-49c8-9cb7-d3d635da0198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:12.785248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-757cbd0f-80fa-49c8-9cb7-d3d635da0198 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:12.787054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-757cbd0f-80fa-49c8-9cb7-d3d635da0198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:12.801240 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be432cf-2fc3-4554-a62d-dddadcad207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:12.802600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be432cf-2fc3-4554-a62d-dddadcad207c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:12.803071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be432cf-2fc3-4554-a62d-dddadcad207c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:12.803558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be432cf-2fc3-4554-a62d-dddadcad207c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:12.824692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:12.893159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 367/719] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:45:12.893159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cbd0f-80fa-49c8-9cb7-d3d635da0198 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:12.934936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be432cf-2fc3-4554-a62d-dddadcad207c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:12.937434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be432cf-2fc3-4554-a62d-dddadcad207c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:13.012681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:13.046177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cbd0f-80fa-49c8-9cb7-d3d635da0198 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:13.077633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 353/720] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:45:13.078561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be432cf-2fc3-4554-a62d-dddadcad207c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:13.097334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0615e3-4a4c-46d3-8ca9-8055e952a4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:13.098236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0615e3-4a4c-46d3-8ca9-8055e952a4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.098519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0615e3-4a4c-46d3-8ca9-8055e952a4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.098794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0615e3-4a4c-46d3-8ca9-8055e952a4e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.111562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0615e3-4a4c-46d3-8ca9-8055e952a4e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:13.113715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0615e3-4a4c-46d3-8ca9-8055e952a4e4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-6d0615e3-4a4c-46d3-8ca9-8055e952a4e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:13.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:13.131240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:13.132169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:13.132169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:13.132169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:13.132169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:13.136301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 368/721] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:13.137488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0615e3-4a4c-46d3-8ca9-8055e952a4e4 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:13.158553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:13.208702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be432cf-2fc3-4554-a62d-dddadcad207c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:13.246296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fd976-fb9e-4c00-9bc7-7bc816362b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:13.246931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd976-fb9e-4c00-9bc7-7bc816362b81 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.247195 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd976-fb9e-4c00-9bc7-7bc816362b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.247475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd976-fb9e-4c00-9bc7-7bc816362b81 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.248173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fd976-fb9e-4c00-9bc7-7bc816362b81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:13.249660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fd976-fb9e-4c00-9bc7-7bc816362b81 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:13.251737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0615e3-4a4c-46d3-8ca9-8055e952a4e4 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:13.287406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af1629-3997-4326-9582-c441c6ac2694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:13.287977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af1629-3997-4326-9582-c441c6ac2694 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.288260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af1629-3997-4326-9582-c441c6ac2694 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.288536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af1629-3997-4326-9582-c441c6ac2694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.299017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af1629-3997-4326-9582-c441c6ac2694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:13.301397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af1629-3997-4326-9582-c441c6ac2694 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-09af1629-3997-4326-9582-c441c6ac2694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:13.317015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:13.318167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:13.319114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:13.319114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:13.319114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:13.319114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:13.321261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 369/722] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:13.322349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af1629-3997-4326-9582-c441c6ac2694 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:13.355753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 354/723] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:45:13 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:13.357448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb7517-af02-46f9-b42e-c69c125da45a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.357908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb7517-af02-46f9-b42e-c69c125da45a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.358348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb7517-af02-46f9-b42e-c69c125da45a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.363462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 355/724] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:13.363462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb7517-af02-46f9-b42e-c69c125da45a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:13.387357 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:13.415109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:13.452980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af1629-3997-4326-9582-c441c6ac2694 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:13.517814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb7517-af02-46f9-b42e-c69c125da45a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:13.521345 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff360f-fa91-4a88-ab5b-c5a29b6b5128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:13.523106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff360f-fa91-4a88-ab5b-c5a29b6b5128 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.523459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff360f-fa91-4a88-ab5b-c5a29b6b5128 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.523845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff360f-fa91-4a88-ab5b-c5a29b6b5128 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.524640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff360f-fa91-4a88-ab5b-c5a29b6b5128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:13.525101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff360f-fa91-4a88-ab5b-c5a29b6b5128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:13.526855 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff360f-fa91-4a88-ab5b-c5a29b6b5128 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:13.544403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 370/725] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:13.549579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30850f-ae89-4ea2-acde-ca431fab9e5c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.549579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30850f-ae89-4ea2-acde-ca431fab9e5c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.549579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30850f-ae89-4ea2-acde-ca431fab9e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.571502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4b30850f-ae89-4ea2-acde-ca431fab9e5c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:13.572719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4b30850f-ae89-4ea2-acde-ca431fab9e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:13.573871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ddcb0-b3d9-4feb-ae0d-d565dfeb9653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:13.575088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ddcb0-b3d9-4feb-ae0d-d565dfeb9653 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.575593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ddcb0-b3d9-4feb-ae0d-d565dfeb9653 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.576082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ddcb0-b3d9-4feb-ae0d-d565dfeb9653 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.576928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ddcb0-b3d9-4feb-ae0d-d565dfeb9653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:13.577331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ddcb0-b3d9-4feb-ae0d-d565dfeb9653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:13.578838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ddcb0-b3d9-4feb-ae0d-d565dfeb9653 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:13.593253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 356/726] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:13.594383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ddcb0-b3d9-4feb-ae0d-d565dfeb9653 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:13.653040 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 371/727] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:45:13.653954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30850f-ae89-4ea2-acde-ca431fab9e5c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:13.686887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:13.725897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ddcb0-b3d9-4feb-ae0d-d565dfeb9653 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:13.745490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:13.762741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc023c3-bf1e-4556-9957-6c1fbfaf1e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:13.763401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc023c3-bf1e-4556-9957-6c1fbfaf1e58 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.763684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc023c3-bf1e-4556-9957-6c1fbfaf1e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.764028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc023c3-bf1e-4556-9957-6c1fbfaf1e58 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.773331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc023c3-bf1e-4556-9957-6c1fbfaf1e58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:13.774812 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc023c3-bf1e-4556-9957-6c1fbfaf1e58 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-6bc023c3-bf1e-4556-9957-6c1fbfaf1e58 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:13.787955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:13.789167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:13.790325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:13.790325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:13.790325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:13.790325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:13.790325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:13.790325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:13.790325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:13.790325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:13.790325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:13.790325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:13.793801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 357/728] 10.222.0.55 () {56 vars in 1117 bytes} [Mon Jul 25 22:45:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:13.794717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc023c3-bf1e-4556-9957-6c1fbfaf1e58 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:13.809797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30850f-ae89-4ea2-acde-ca431fab9e5c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:13.849770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661a169-8dfa-470f-97cc-2f5c704f800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:13.850672 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661a169-8dfa-470f-97cc-2f5c704f800c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.851107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661a169-8dfa-470f-97cc-2f5c704f800c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.851603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661a169-8dfa-470f-97cc-2f5c704f800c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.859546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661a169-8dfa-470f-97cc-2f5c704f800c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:13.861355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661a169-8dfa-470f-97cc-2f5c704f800c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-0661a169-8dfa-470f-97cc-2f5c704f800c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:13.874764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:13.875945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:13.877034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:13.877034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:13.877034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:13.877034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:13.877034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:13.877034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:13.877034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:13.877034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:13.883881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 372/729] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:13.885018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661a169-8dfa-470f-97cc-2f5c704f800c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:13.903446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc023c3-bf1e-4556-9957-6c1fbfaf1e58 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:13.936518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:13.941891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1b2c2-3742-49b6-a105-bb5d68e811bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:13.942679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1b2c2-3742-49b6-a105-bb5d68e811bf None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.942969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1b2c2-3742-49b6-a105-bb5d68e811bf None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.943246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1b2c2-3742-49b6-a105-bb5d68e811bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.954911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1b2c2-3742-49b6-a105-bb5d68e811bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-04c1b2c2-3742-49b6-a105-bb5d68e811bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:13.960523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:13.961727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:13.962781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 358/730] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:13.963480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1b2c2-3742-49b6-a105-bb5d68e811bf None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:14.006527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661a169-8dfa-470f-97cc-2f5c704f800c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:14.025775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.047458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412fbe-ad28-44c3-b51d-a856097bb594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:14.048465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412fbe-ad28-44c3-b51d-a856097bb594 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.048973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412fbe-ad28-44c3-b51d-a856097bb594 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.049434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412fbe-ad28-44c3-b51d-a856097bb594 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.050595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56412fbe-ad28-44c3-b51d-a856097bb594 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:14.051072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56412fbe-ad28-44c3-b51d-a856097bb594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:14.052978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56412fbe-ad28-44c3-b51d-a856097bb594 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:14.074757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 373/731] 10.222.0.55 () {56 vars in 1149 bytes} [Mon Jul 25 22:45:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:14.075903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412fbe-ad28-44c3-b51d-a856097bb594 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:14.077574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1b2c2-3742-49b6-a105-bb5d68e811bf None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:14.130221 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265deb5e-e0f5-42c1-a336-80f6982d9517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:14.131171 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265deb5e-e0f5-42c1-a336-80f6982d9517 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.131635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265deb5e-e0f5-42c1-a336-80f6982d9517 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.132061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265deb5e-e0f5-42c1-a336-80f6982d9517 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.133805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265deb5e-e0f5-42c1-a336-80f6982d9517 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:14.134295 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265deb5e-e0f5-42c1-a336-80f6982d9517 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:14.136448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265deb5e-e0f5-42c1-a336-80f6982d9517 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:14.160119 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 359/732] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:14.160119 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265deb5e-e0f5-42c1-a336-80f6982d9517 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:14.212617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412fbe-ad28-44c3-b51d-a856097bb594 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:14.218730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.254548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bad4ac-4822-4467-b232-5270efab5147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:14.255553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bad4ac-4822-4467-b232-5270efab5147 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.256032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bad4ac-4822-4467-b232-5270efab5147 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.256511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bad4ac-4822-4467-b232-5270efab5147 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.257546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bad4ac-4822-4467-b232-5270efab5147 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:14.258047 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bad4ac-4822-4467-b232-5270efab5147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:14.259734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bad4ac-4822-4467-b232-5270efab5147 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:14.270573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 374/733] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:45:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:14.271211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265deb5e-e0f5-42c1-a336-80f6982d9517 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:14.272000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bad4ac-4822-4467-b232-5270efab5147 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:14.312167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1f06d-7088-455d-9696-cecd6ac45ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:14.312670 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.313457 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1f06d-7088-455d-9696-cecd6ac45ded None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.313641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1f06d-7088-455d-9696-cecd6ac45ded None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.314648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1f06d-7088-455d-9696-cecd6ac45ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.388084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1f06d-7088-455d-9696-cecd6ac45ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:14.389596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1f06d-7088-455d-9696-cecd6ac45ded None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:14.390134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bad4ac-4822-4467-b232-5270efab5147 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:14.430896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbf589-8677-4fc0-9c28-293f871c92ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:14.431981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbf589-8677-4fc0-9c28-293f871c92ed None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.432481 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbf589-8677-4fc0-9c28-293f871c92ed None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.432968 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbf589-8677-4fc0-9c28-293f871c92ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.434080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbf589-8677-4fc0-9c28-293f871c92ed None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=eea60163008a4bea95d130a5809fc50d) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:14.434588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbf589-8677-4fc0-9c28-293f871c92ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:14.436330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbf589-8677-4fc0-9c28-293f871c92ed None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:14.449521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.450182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 375/734] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:14 2022] GET /identity/v3/role_assignments?user.id=eea60163008a4bea95d130a5809fc50d&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:14.452052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbf589-8677-4fc0-9c28-293f871c92ed None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:14.506880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 360/735] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:45:14.509356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1f06d-7088-455d-9696-cecd6ac45ded None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:14.578813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbf589-8677-4fc0-9c28-293f871c92ed None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:14.583134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.622031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01789d-c091-4da1-be0f-3476546c691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:14.622926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01789d-c091-4da1-be0f-3476546c691b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.623305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01789d-c091-4da1-be0f-3476546c691b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.623706 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01789d-c091-4da1-be0f-3476546c691b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.623875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1f06d-7088-455d-9696-cecd6ac45ded None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:14.637375 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01789d-c091-4da1-be0f-3476546c691b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:14.639015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01789d-c091-4da1-be0f-3476546c691b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-bf01789d-c091-4da1-be0f-3476546c691b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:14.656269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:14.657522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:14.658618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:14.658618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:14.658618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:14.658618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:14.660973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 376/736] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:14.662581 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45095d-20f2-4591-9e32-071b5f4c5389 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.662961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45095d-20f2-4591-9e32-071b5f4c5389 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.663329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45095d-20f2-4591-9e32-071b5f4c5389 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.663946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5fdda-1c43-4e19-a453-8e715c65f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:14.664599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5fdda-1c43-4e19-a453-8e715c65f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.664882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5fdda-1c43-4e19-a453-8e715c65f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.665184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5fdda-1c43-4e19-a453-8e715c65f2d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.665460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 377/737] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:14.670799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c38c7-b84b-429f-80be-f32b758bffe8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.671407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c38c7-b84b-429f-80be-f32b758bffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.671886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c38c7-b84b-429f-80be-f32b758bffe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.678180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5fdda-1c43-4e19-a453-8e715c65f2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:14.679746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5fdda-1c43-4e19-a453-8e715c65f2d1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:14.696202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-fd3c38c7-b84b-429f-80be-f32b758bffe8 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:14.697446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fd3c38c7-b84b-429f-80be-f32b758bffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-59b5fdda-1c43-4e19-a453-8e715c65f2d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:14.698719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:14.699560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:14.700458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:14.700458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:14.700458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:14.700458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:14.702231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 361/738] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:14.703263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5fdda-1c43-4e19-a453-8e715c65f2d1 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:14.709461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.785340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 378/739] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:45:14.786316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c38c7-b84b-429f-80be-f32b758bffe8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:14.813702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5fdda-1c43-4e19-a453-8e715c65f2d1 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:14.863237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6d2fa-7b5f-4466-9630-96c8f7d54fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:14.863987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d2fa-7b5f-4466-9630-96c8f7d54fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.864274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d2fa-7b5f-4466-9630-96c8f7d54fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.864557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d2fa-7b5f-4466-9630-96c8f7d54fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.865296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6d2fa-7b5f-4466-9630-96c8f7d54fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:14.865616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6d2fa-7b5f-4466-9630-96c8f7d54fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:14.866984 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6d2fa-7b5f-4466-9630-96c8f7d54fd0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:14.884253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 362/740] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:14.885385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6d2fa-7b5f-4466-9630-96c8f7d54fd0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:14.910141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.932242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c38c7-b84b-429f-80be-f32b758bffe8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:14.953256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.976688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ef90e-b60f-4963-8496-2a0cec33f0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:14.977712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ef90e-b60f-4963-8496-2a0cec33f0bd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.978256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ef90e-b60f-4963-8496-2a0cec33f0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.978782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ef90e-b60f-4963-8496-2a0cec33f0bd None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.979743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ef90e-b60f-4963-8496-2a0cec33f0bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:14.980258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ef90e-b60f-4963-8496-2a0cec33f0bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:14.982121 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ef90e-b60f-4963-8496-2a0cec33f0bd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:14.996437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 379/741] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:14.997705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ef90e-b60f-4963-8496-2a0cec33f0bd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:15.001559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6d2fa-7b5f-4466-9630-96c8f7d54fd0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:15.043257 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cb216-f64e-4cce-8364-fefa6e9b307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:15.043999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cb216-f64e-4cce-8364-fefa6e9b307c None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.044284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cb216-f64e-4cce-8364-fefa6e9b307c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.044713 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cb216-f64e-4cce-8364-fefa6e9b307c None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.045538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cb216-f64e-4cce-8364-fefa6e9b307c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:15.047160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cb216-f64e-4cce-8364-fefa6e9b307c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:15.116298 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ef90e-b60f-4963-8496-2a0cec33f0bd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:15.152682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd94f5-137f-4af6-b855-29a71da51a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:15.153443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd94f5-137f-4af6-b855-29a71da51a26 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.153727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd94f5-137f-4af6-b855-29a71da51a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.154006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd94f5-137f-4af6-b855-29a71da51a26 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.164431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd94f5-137f-4af6-b855-29a71da51a26 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:15.165445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 363/742] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:45:14 2022] POST /identity/v3/services => generated 240 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:15.165942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd94f5-137f-4af6-b855-29a71da51a26 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:15.167258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cb216-f64e-4cce-8364-fefa6e9b307c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-63bd94f5-137f-4af6-b855-29a71da51a26 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:15.180987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:15.182385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:15.183347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 380/743] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:45:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:15.198997 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd94f5-137f-4af6-b855-29a71da51a26 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:15.203434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:15.320737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cb216-f64e-4cce-8364-fefa6e9b307c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:15.350327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:15.368877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f87ff5-027f-463c-9706-7faa1f9391a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:15.370265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f87ff5-027f-463c-9706-7faa1f9391a0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.370776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f87ff5-027f-463c-9706-7faa1f9391a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.371282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f87ff5-027f-463c-9706-7faa1f9391a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.380545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f87ff5-027f-463c-9706-7faa1f9391a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:15.382505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f87ff5-027f-463c-9706-7faa1f9391a0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-35f87ff5-027f-463c-9706-7faa1f9391a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:15.399109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:15.400095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:15.400975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:15.400975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:15.400975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:15.400975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:15.400975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:15.400975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:15.400975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:15.400975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:15.403896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 364/744] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:15.410870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f87ff5-027f-463c-9706-7faa1f9391a0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:15.423769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd94f5-137f-4af6-b855-29a71da51a26 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:15.492909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ddeff-6b40-4466-8b46-e472d1cb8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:15.493894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddeff-6b40-4466-8b46-e472d1cb8027 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.494179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddeff-6b40-4466-8b46-e472d1cb8027 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.494461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddeff-6b40-4466-8b46-e472d1cb8027 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.495596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ddeff-6b40-4466-8b46-e472d1cb8027 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:15.495907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ddeff-6b40-4466-8b46-e472d1cb8027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:15.497624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ddeff-6b40-4466-8b46-e472d1cb8027 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:15.529240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 381/745] 10.222.0.55 () {56 vars in 1135 bytes} [Mon Jul 25 22:45:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:15.531828 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ddeff-6b40-4466-8b46-e472d1cb8027 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:15.573619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f87ff5-027f-463c-9706-7faa1f9391a0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:15.619428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:15.624158 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468e31f-7059-4431-b17d-47e163ad92b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:15.625239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468e31f-7059-4431-b17d-47e163ad92b0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.625699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468e31f-7059-4431-b17d-47e163ad92b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.626182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468e31f-7059-4431-b17d-47e163ad92b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.627588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468e31f-7059-4431-b17d-47e163ad92b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:15.628137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468e31f-7059-4431-b17d-47e163ad92b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:15.630944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468e31f-7059-4431-b17d-47e163ad92b0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:15.655700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 365/746] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:15.657770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551365af-35ee-4eb1-b7a8-f0d10a2ca444 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.658323 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551365af-35ee-4eb1-b7a8-f0d10a2ca444 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.658803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551365af-35ee-4eb1-b7a8-f0d10a2ca444 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.662673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 366/747] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:15.666787 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551365af-35ee-4eb1-b7a8-f0d10a2ca444 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:15.683868 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ddeff-6b40-4466-8b46-e472d1cb8027 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:15.731470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011137e-782d-46dc-940c-bc0f2a94b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:15.733560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011137e-782d-46dc-940c-bc0f2a94b3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.734127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011137e-782d-46dc-940c-bc0f2a94b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.734696 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011137e-782d-46dc-940c-bc0f2a94b3d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.748046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:15.822888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551365af-35ee-4eb1-b7a8-f0d10a2ca444 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:15.833132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011137e-782d-46dc-940c-bc0f2a94b3d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:15.835859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011137e-782d-46dc-940c-bc0f2a94b3d5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:15.875949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576e9de-7e71-47a5-ba35-a2079f3bcab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:15.877052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576e9de-7e71-47a5-ba35-a2079f3bcab8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.877513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576e9de-7e71-47a5-ba35-a2079f3bcab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.878091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576e9de-7e71-47a5-ba35-a2079f3bcab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.879207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576e9de-7e71-47a5-ba35-a2079f3bcab8 None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=508186f65cac4ab6b4643d0255725c41) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:15.879735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576e9de-7e71-47a5-ba35-a2079f3bcab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:15.881642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576e9de-7e71-47a5-ba35-a2079f3bcab8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:15.888701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 367/748] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:15 2022] GET /identity/v3/role_assignments?user.id=508186f65cac4ab6b4643d0255725c41&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:15.890285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949048d5-fb0f-4ee6-9c0e-b13bc56f7a2e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.890719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949048d5-fb0f-4ee6-9c0e-b13bc56f7a2e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.891141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949048d5-fb0f-4ee6-9c0e-b13bc56f7a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.913489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-949048d5-fb0f-4ee6-9c0e-b13bc56f7a2e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:15.915080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-949048d5-fb0f-4ee6-9c0e-b13bc56f7a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:15.929096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:16.025197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 382/749] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:45:16.026861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011137e-782d-46dc-940c-bc0f2a94b3d5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:16.062511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 368/750] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:16.104375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949048d5-fb0f-4ee6-9c0e-b13bc56f7a2e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:16.146963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011137e-782d-46dc-940c-bc0f2a94b3d5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:16.169746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:16.245929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7a336-8adb-44ea-a40b-36e5b6afa725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:16.246600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a336-8adb-44ea-a40b-36e5b6afa725 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:16.246878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a336-8adb-44ea-a40b-36e5b6afa725 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:16.247145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a336-8adb-44ea-a40b-36e5b6afa725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:16.270215 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7a336-8adb-44ea-a40b-36e5b6afa725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:16.273360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7a336-8adb-44ea-a40b-36e5b6afa725 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f3f7a336-8adb-44ea-a40b-36e5b6afa725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:16.298078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:16.299041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:16.300625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:16.300625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:16.300625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:16.300625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:16.305618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 383/751] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:16.307389 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949048d5-fb0f-4ee6-9c0e-b13bc56f7a2e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:16.311635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7a336-8adb-44ea-a40b-36e5b6afa725 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:16.341734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:16.364846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0da58d-d564-42a6-ac4b-89e996a35135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:16.365532 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0da58d-d564-42a6-ac4b-89e996a35135 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:16.365811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0da58d-d564-42a6-ac4b-89e996a35135 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:16.366086 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0da58d-d564-42a6-ac4b-89e996a35135 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:16.366726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0da58d-d564-42a6-ac4b-89e996a35135 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:16.368129 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0da58d-d564-42a6-ac4b-89e996a35135 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-ed0da58d-d564-42a6-ac4b-89e996a35135 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:16.384877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:16.387480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:16.389681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 369/752] 10.222.0.55 () {56 vars in 1129 bytes} [Mon Jul 25 22:45:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:16.396825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0da58d-d564-42a6-ac4b-89e996a35135 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:16.486360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7a336-8adb-44ea-a40b-36e5b6afa725 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:16.530578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6326091-e9c8-41c3-851a-76356bd0903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:16.531216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6326091-e9c8-41c3-851a-76356bd0903e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:16.531499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6326091-e9c8-41c3-851a-76356bd0903e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:16.531774 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6326091-e9c8-41c3-851a-76356bd0903e None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:16.532489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6326091-e9c8-41c3-851a-76356bd0903e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:16.532796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6326091-e9c8-41c3-851a-76356bd0903e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:16.534752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6326091-e9c8-41c3-851a-76356bd0903e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:16.560761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 384/753] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:16.567376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6326091-e9c8-41c3-851a-76356bd0903e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:16.599052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:16.604042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0da58d-d564-42a6-ac4b-89e996a35135 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:16.657897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577082d-2cef-4c4c-b5cc-eda1ec7fec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:16.660092 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577082d-2cef-4c4c-b5cc-eda1ec7fec96 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:16.660673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577082d-2cef-4c4c-b5cc-eda1ec7fec96 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:16.661203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577082d-2cef-4c4c-b5cc-eda1ec7fec96 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:16.662175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577082d-2cef-4c4c-b5cc-eda1ec7fec96 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:16.662696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577082d-2cef-4c4c-b5cc-eda1ec7fec96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:16.664331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577082d-2cef-4c4c-b5cc-eda1ec7fec96 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:16.674344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 370/754] 10.222.0.55 () {56 vars in 1124 bytes} [Mon Jul 25 22:45:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:16.681277 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577082d-2cef-4c4c-b5cc-eda1ec7fec96 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:16.690220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:16.744376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6326091-e9c8-41c3-851a-76356bd0903e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:16.788635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8803e47-90bb-49f1-8a5d-c4fe11c3699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:16.789318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8803e47-90bb-49f1-8a5d-c4fe11c3699c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:16.789318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8803e47-90bb-49f1-8a5d-c4fe11c3699c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:16.789318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8803e47-90bb-49f1-8a5d-c4fe11c3699c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:16.801470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8803e47-90bb-49f1-8a5d-c4fe11c3699c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:16.801470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8803e47-90bb-49f1-8a5d-c4fe11c3699c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f8803e47-90bb-49f1-8a5d-c4fe11c3699c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:16.812541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:16.813511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 385/755] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd86f5-2e47-427f-927a-63e08f06e14f None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:16.817222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd86f5-2e47-427f-927a-63e08f06e14f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:16.817821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd86f5-2e47-427f-927a-63e08f06e14f None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:16.822659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 386/756] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:16.823572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd86f5-2e47-427f-927a-63e08f06e14f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:16.826180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577082d-2cef-4c4c-b5cc-eda1ec7fec96 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:16.872825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369d375-e276-45e0-a953-40dee2f0d256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:16.873853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369d375-e276-45e0-a953-40dee2f0d256 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:16.874382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369d375-e276-45e0-a953-40dee2f0d256 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:16.874924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369d375-e276-45e0-a953-40dee2f0d256 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:16.875809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369d375-e276-45e0-a953-40dee2f0d256 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:16.876355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369d375-e276-45e0-a953-40dee2f0d256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:16.878040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369d375-e276-45e0-a953-40dee2f0d256 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:16.888479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 371/757] 10.222.0.55 () {56 vars in 1124 bytes} [Mon Jul 25 22:45:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:16.890080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01e51f-bce9-4c8d-95dd-e60c347526e5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:16.890586 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01e51f-bce9-4c8d-95dd-e60c347526e5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:16.891104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01e51f-bce9-4c8d-95dd-e60c347526e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:16.910999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8f01e51f-bce9-4c8d-95dd-e60c347526e5 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:16.912693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8f01e51f-bce9-4c8d-95dd-e60c347526e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:16.935581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:16.943817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd86f5-2e47-427f-927a-63e08f06e14f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:16.977196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:16.983031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acaf74-d64e-4447-a47a-3d787e3e9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:16.983946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acaf74-d64e-4447-a47a-3d787e3e9180 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:16.984401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acaf74-d64e-4447-a47a-3d787e3e9180 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:16.984906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acaf74-d64e-4447-a47a-3d787e3e9180 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:16.985880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acaf74-d64e-4447-a47a-3d787e3e9180 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:16.986401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acaf74-d64e-4447-a47a-3d787e3e9180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:16.988805 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acaf74-d64e-4447-a47a-3d787e3e9180 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:16.995019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 372/758] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:16.995019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01e51f-bce9-4c8d-95dd-e60c347526e5 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:17.017223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 387/759] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:17.023649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acaf74-d64e-4447-a47a-3d787e3e9180 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:17.151449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01e51f-bce9-4c8d-95dd-e60c347526e5 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:17.211420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3de08f-ef98-4ded-8a33-20e876ca0e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:17.211636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acaf74-d64e-4447-a47a-3d787e3e9180 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:17.212067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3de08f-ef98-4ded-8a33-20e876ca0e9c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.212348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3de08f-ef98-4ded-8a33-20e876ca0e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.212620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3de08f-ef98-4ded-8a33-20e876ca0e9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.213433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3de08f-ef98-4ded-8a33-20e876ca0e9c None admin] RBAC: Adding query filter params (interface=public, service_id=618fe41c348644f3893f85499e42038d, region_id=RegionOne) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:17.213746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3de08f-ef98-4ded-8a33-20e876ca0e9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:17.216599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3de08f-ef98-4ded-8a33-20e876ca0e9c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:17.229306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 373/760] 10.222.0.55 () {56 vars in 1251 bytes} [Mon Jul 25 22:45:16 2022] GET /identity/v3/endpoints?service_id=618fe41c348644f3893f85499e42038d&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:17.230861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3de08f-ef98-4ded-8a33-20e876ca0e9c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:17.256034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5292bd-57b2-48ba-88b1-6ba0d12f4e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:17.256725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5292bd-57b2-48ba-88b1-6ba0d12f4e6e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.257074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5292bd-57b2-48ba-88b1-6ba0d12f4e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.257479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5292bd-57b2-48ba-88b1-6ba0d12f4e6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.258376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5292bd-57b2-48ba-88b1-6ba0d12f4e6e None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=6db67b0bfa2a4c0f84fad07ac144b7bd) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:17.258753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5292bd-57b2-48ba-88b1-6ba0d12f4e6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:17.260357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5292bd-57b2-48ba-88b1-6ba0d12f4e6e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:17.264174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:17.267695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 388/761] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:17 2022] GET /identity/v3/role_assignments?user.id=6db67b0bfa2a4c0f84fad07ac144b7bd&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:17.268814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5292bd-57b2-48ba-88b1-6ba0d12f4e6e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:17.363872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:17.435168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3de08f-ef98-4ded-8a33-20e876ca0e9c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:17.436378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5292bd-57b2-48ba-88b1-6ba0d12f4e6e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:17.476032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54e109-590f-4102-813e-47a7bd8d15aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:17.476671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54e109-590f-4102-813e-47a7bd8d15aa None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.476938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54e109-590f-4102-813e-47a7bd8d15aa None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.477298 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54e109-590f-4102-813e-47a7bd8d15aa None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.478502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54e109-590f-4102-813e-47a7bd8d15aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:17.479787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54e109-590f-4102-813e-47a7bd8d15aa None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:17.486557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 389/762] 10.222.0.55 () {56 vars in 1087 bytes} [Mon Jul 25 22:45:17 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:17.509476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbafa9-798e-48fd-a2e5-2e3146eaec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:17.510054 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbafa9-798e-48fd-a2e5-2e3146eaec57 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.510333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbafa9-798e-48fd-a2e5-2e3146eaec57 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.510608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbafa9-798e-48fd-a2e5-2e3146eaec57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.524350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbafa9-798e-48fd-a2e5-2e3146eaec57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1bfbafa9-798e-48fd-a2e5-2e3146eaec57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:17.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:17.531131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:17.532640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 374/763] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:17.538974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54e109-590f-4102-813e-47a7bd8d15aa None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:17.667302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54e109-590f-4102-813e-47a7bd8d15aa None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:17.689216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:17.709627 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b868578-9e8d-457d-98d3-cde5553b0ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:17.710277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868578-9e8d-457d-98d3-cde5553b0ebc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.710556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868578-9e8d-457d-98d3-cde5553b0ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.710827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868578-9e8d-457d-98d3-cde5553b0ebc None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.711574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b868578-9e8d-457d-98d3-cde5553b0ebc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:17.711879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b868578-9e8d-457d-98d3-cde5553b0ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:17.713332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b868578-9e8d-457d-98d3-cde5553b0ebc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:17.730295 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 390/764] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:17.736062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbafa9-798e-48fd-a2e5-2e3146eaec57 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:17.838008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:17.858449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a197f3c-263e-4571-9d32-091716bdb964 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.858783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a197f3c-263e-4571-9d32-091716bdb964 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.858995 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a197f3c-263e-4571-9d32-091716bdb964 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.860580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 391/765] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:17.865879 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbafa9-798e-48fd-a2e5-2e3146eaec57 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:17.866892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4688c-8aad-4e54-8692-6b1ee17038c0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.867426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4688c-8aad-4e54-8692-6b1ee17038c0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.867915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4688c-8aad-4e54-8692-6b1ee17038c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.902308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e0c4688c-8aad-4e54-8692-6b1ee17038c0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:17.903908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e0c4688c-8aad-4e54-8692-6b1ee17038c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:17.909806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715148ee-c33e-49fc-95b1-97539ed87401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:17.909806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715148ee-c33e-49fc-95b1-97539ed87401 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.909806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715148ee-c33e-49fc-95b1-97539ed87401 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.909806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715148ee-c33e-49fc-95b1-97539ed87401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.921469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715148ee-c33e-49fc-95b1-97539ed87401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:17.923554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715148ee-c33e-49fc-95b1-97539ed87401 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-715148ee-c33e-49fc-95b1-97539ed87401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:17.941526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:17.942537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:17.943889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:17.943889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:17.943889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:17.943889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:17.943889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 375/766] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:17.951849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715148ee-c33e-49fc-95b1-97539ed87401 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:18.054866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 392/767] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:18.080123 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4688c-8aad-4e54-8692-6b1ee17038c0 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:18.183434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715148ee-c33e-49fc-95b1-97539ed87401 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:18.216163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4688c-8aad-4e54-8692-6b1ee17038c0 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:18.246965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:18.253575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:18.265333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bb2f7-96a4-45f8-85b5-21bcf87a3269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:18.266797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bb2f7-96a4-45f8-85b5-21bcf87a3269 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:18.267579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bb2f7-96a4-45f8-85b5-21bcf87a3269 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:18.268110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bb2f7-96a4-45f8-85b5-21bcf87a3269 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:18.269291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bb2f7-96a4-45f8-85b5-21bcf87a3269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:18.270319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bb2f7-96a4-45f8-85b5-21bcf87a3269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:18.272256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bb2f7-96a4-45f8-85b5-21bcf87a3269 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:18.274918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d47cb6-dec0-4e33-8ce9-5d9292078aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:18.275575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d47cb6-dec0-4e33-8ce9-5d9292078aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:18.275855 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d47cb6-dec0-4e33-8ce9-5d9292078aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:18.276126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d47cb6-dec0-4e33-8ce9-5d9292078aa6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:18.277371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d47cb6-dec0-4e33-8ce9-5d9292078aa6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:18.278835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d47cb6-dec0-4e33-8ce9-5d9292078aa6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-42d47cb6-dec0-4e33-8ce9-5d9292078aa6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:18.290572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:18.292900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:18.294548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 393/768] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:18 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:18.298235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af319a-67ec-4657-a03d-f5110518be54 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:18.298567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af319a-67ec-4657-a03d-f5110518be54 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:18.298805 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af319a-67ec-4657-a03d-f5110518be54 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:18.302170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 376/769] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:18.302801 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 394/770] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:18.303975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bb2f7-96a4-45f8-85b5-21bcf87a3269 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:18.308730 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0193-079a-4fd8-89e7-04db32c7f25a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:18.309152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0193-079a-4fd8-89e7-04db32c7f25a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:18.309388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0193-079a-4fd8-89e7-04db32c7f25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:18.335958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e0dc0193-079a-4fd8-89e7-04db32c7f25a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:18.337333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e0dc0193-079a-4fd8-89e7-04db32c7f25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:18.449307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 395/771] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:18.450570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc0193-079a-4fd8-89e7-04db32c7f25a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:18.481353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bb2f7-96a4-45f8-85b5-21bcf87a3269 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:18.531139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13d769-5ebe-42f6-a10f-e4b5b7f79755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:18.532465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13d769-5ebe-42f6-a10f-e4b5b7f79755 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:18.532968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13d769-5ebe-42f6-a10f-e4b5b7f79755 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:18.533785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13d769-5ebe-42f6-a10f-e4b5b7f79755 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:18.535555 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13d769-5ebe-42f6-a10f-e4b5b7f79755 None admin] RBAC: Adding query filter params (name=network) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:18.536064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13d769-5ebe-42f6-a10f-e4b5b7f79755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:18.537887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13d769-5ebe-42f6-a10f-e4b5b7f79755 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:18.544829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 377/772] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:18.546133 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13d769-5ebe-42f6-a10f-e4b5b7f79755 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:18.611666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc0193-079a-4fd8-89e7-04db32c7f25a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:18.623114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:18.641530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:18.651220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9dec-e0f1-483d-b912-360bf754659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:18.652265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9dec-e0f1-483d-b912-360bf754659c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:18.652758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9dec-e0f1-483d-b912-360bf754659c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:18.653274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9dec-e0f1-483d-b912-360bf754659c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:18.663447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f9dec-e0f1-483d-b912-360bf754659c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:18.665383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f9dec-e0f1-483d-b912-360bf754659c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4c8f9dec-e0f1-483d-b912-360bf754659c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:18.679409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:18.680423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:18.681404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:18.681404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:18.681404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:18.681404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:18.681404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:18.681404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:18.681404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:18.681404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:18.681404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:45:18.681404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:18.684119 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 396/773] 10.222.0.55 () {56 vars in 1093 bytes} [Mon Jul 25 22:45:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:18.685299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9dec-e0f1-483d-b912-360bf754659c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:18.717237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13d769-5ebe-42f6-a10f-e4b5b7f79755 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:18.758952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b22395-0445-4224-a9e9-e64979f01068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:18.759611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b22395-0445-4224-a9e9-e64979f01068 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:18.759881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b22395-0445-4224-a9e9-e64979f01068 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:18.760124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b22395-0445-4224-a9e9-e64979f01068 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:18.773356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b22395-0445-4224-a9e9-e64979f01068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-52b22395-0445-4224-a9e9-e64979f01068 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:18.778137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:18.779074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 378/774] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:18.780316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b22395-0445-4224-a9e9-e64979f01068 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:18.805023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9dec-e0f1-483d-b912-360bf754659c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:18.851018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74996aa-7fee-4959-8ec0-2211726fd488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:18.851754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74996aa-7fee-4959-8ec0-2211726fd488 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:18.852043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74996aa-7fee-4959-8ec0-2211726fd488 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:18.852373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74996aa-7fee-4959-8ec0-2211726fd488 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:18.853070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74996aa-7fee-4959-8ec0-2211726fd488 None admin] RBAC: Adding query filter params (type=network) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:18.853454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74996aa-7fee-4959-8ec0-2211726fd488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:18.858414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74996aa-7fee-4959-8ec0-2211726fd488 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:18.872304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 397/775] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:18.873405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74996aa-7fee-4959-8ec0-2211726fd488 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:18.901612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b22395-0445-4224-a9e9-e64979f01068 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:18.915144 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:18.924374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:18.946079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a80e5-5ef1-42f8-9e0c-a55548c02e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:18.947042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a80e5-5ef1-42f8-9e0c-a55548c02e39 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:18.948345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a80e5-5ef1-42f8-9e0c-a55548c02e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:18.949446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a80e5-5ef1-42f8-9e0c-a55548c02e39 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:18.950303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a80e5-5ef1-42f8-9e0c-a55548c02e39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:18.950615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a80e5-5ef1-42f8-9e0c-a55548c02e39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:18.952092 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a80e5-5ef1-42f8-9e0c-a55548c02e39 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:18.981488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 379/776] 10.222.0.55 () {56 vars in 1133 bytes} [Mon Jul 25 22:45:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:18.984688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a80e5-5ef1-42f8-9e0c-a55548c02e39 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:19.010987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74996aa-7fee-4959-8ec0-2211726fd488 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:19.048538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60df7d6-c3c0-4446-b45a-07a81cc54c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:19.049220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60df7d6-c3c0-4446-b45a-07a81cc54c99 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:19.049499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60df7d6-c3c0-4446-b45a-07a81cc54c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:19.049813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60df7d6-c3c0-4446-b45a-07a81cc54c99 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:19.050981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60df7d6-c3c0-4446-b45a-07a81cc54c99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:19.051355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60df7d6-c3c0-4446-b45a-07a81cc54c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:19.053052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60df7d6-c3c0-4446-b45a-07a81cc54c99 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:19.062100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 398/777] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:19.062966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60df7d6-c3c0-4446-b45a-07a81cc54c99 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:19.121800 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a80e5-5ef1-42f8-9e0c-a55548c02e39 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:19.168648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63158e-526a-45c5-84c2-9f4ebe88ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:19.169674 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63158e-526a-45c5-84c2-9f4ebe88ccda None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:19.170285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63158e-526a-45c5-84c2-9f4ebe88ccda None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:19.170887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63158e-526a-45c5-84c2-9f4ebe88ccda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:19.172040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63158e-526a-45c5-84c2-9f4ebe88ccda None admin] RBAC: Adding query filter params (interface=public, service_id=136ca8e7dd3d4f0ead54b01f6f8ceaf3, region_id=RegionOne) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:19.172765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63158e-526a-45c5-84c2-9f4ebe88ccda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:19.174749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63158e-526a-45c5-84c2-9f4ebe88ccda None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:19.182725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 380/778] 10.222.0.55 () {56 vars in 1251 bytes} [Mon Jul 25 22:45:18 2022] GET /identity/v3/endpoints?service_id=136ca8e7dd3d4f0ead54b01f6f8ceaf3&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:19.184050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63158e-526a-45c5-84c2-9f4ebe88ccda None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:19.205520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:19.218661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60df7d6-c3c0-4446-b45a-07a81cc54c99 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:19.257572 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:19.259399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a71f-f07c-440a-9116-8a18ffa87ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:19.260186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a71f-f07c-440a-9116-8a18ffa87ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:19.260561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a71f-f07c-440a-9116-8a18ffa87ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:19.260938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a71f-f07c-440a-9116-8a18ffa87ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:19.274897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a71f-f07c-440a-9116-8a18ffa87ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:19.276565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a71f-f07c-440a-9116-8a18ffa87ed7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-8505a71f-f07c-440a-9116-8a18ffa87ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:19.294337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:19.295510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:19.296605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:19.296605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:19.296605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:19.296605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:19.304278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 399/779] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:19.305784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a71f-f07c-440a-9116-8a18ffa87ed7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:19.310775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63158e-526a-45c5-84c2-9f4ebe88ccda None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:19.365102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ea5c9-8be0-49ea-bf3d-5a5aed701705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:19.366206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ea5c9-8be0-49ea-bf3d-5a5aed701705 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:19.366499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ea5c9-8be0-49ea-bf3d-5a5aed701705 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:19.366774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ea5c9-8be0-49ea-bf3d-5a5aed701705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:19.383659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ea5c9-8be0-49ea-bf3d-5a5aed701705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:19.385970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ea5c9-8be0-49ea-bf3d-5a5aed701705 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-145ea5c9-8be0-49ea-bf3d-5a5aed701705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:19.408506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:19.410794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:19.412576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:19.412576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:19.412576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:19.412576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:19.412576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 381/780] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:19.412576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ea5c9-8be0-49ea-bf3d-5a5aed701705 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:19.451409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a71f-f07c-440a-9116-8a18ffa87ed7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:19.512776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8704c-e589-4c44-91dd-1b97eef17bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:19.513398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8704c-e589-4c44-91dd-1b97eef17bbb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:19.513714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8704c-e589-4c44-91dd-1b97eef17bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:19.514042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8704c-e589-4c44-91dd-1b97eef17bbb None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:19.514710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8704c-e589-4c44-91dd-1b97eef17bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:19.516168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8704c-e589-4c44-91dd-1b97eef17bbb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:19.525363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 400/781] 10.222.0.55 () {56 vars in 1087 bytes} [Mon Jul 25 22:45:19 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:19.527011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8704c-e589-4c44-91dd-1b97eef17bbb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:19.561359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:19.566521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:19.589317 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ea5c9-8be0-49ea-bf3d-5a5aed701705 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:19.665427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fb889-f211-40e0-b3db-09502ea52d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:19.666181 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fb889-f211-40e0-b3db-09502ea52d61 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:19.666464 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fb889-f211-40e0-b3db-09502ea52d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:19.666741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fb889-f211-40e0-b3db-09502ea52d61 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:19.667445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fb889-f211-40e0-b3db-09502ea52d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:19.667757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fb889-f211-40e0-b3db-09502ea52d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:19.669318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fb889-f211-40e0-b3db-09502ea52d61 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:19.691126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 382/782] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:19.693155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c958c60-9d13-462c-83a3-86a6e907cf04 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:19.693155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c958c60-9d13-462c-83a3-86a6e907cf04 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:19.693155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c958c60-9d13-462c-83a3-86a6e907cf04 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:19.695132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 383/783] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:19.702801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470bdf4-64d1-453e-864c-ecce12d8951a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:19.703130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470bdf4-64d1-453e-864c-ecce12d8951a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:19.703371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470bdf4-64d1-453e-864c-ecce12d8951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:19.725243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3470bdf4-64d1-453e-864c-ecce12d8951a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:19.726526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3470bdf4-64d1-453e-864c-ecce12d8951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:19.744467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8704c-e589-4c44-91dd-1b97eef17bbb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:19.796365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e878e-6394-43a2-bbf8-8d234f4a7bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:19.797859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e878e-6394-43a2-bbf8-8d234f4a7bab None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:19.798147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e878e-6394-43a2-bbf8-8d234f4a7bab None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:19.798417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e878e-6394-43a2-bbf8-8d234f4a7bab None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:19.799130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e878e-6394-43a2-bbf8-8d234f4a7bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:19.799436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e878e-6394-43a2-bbf8-8d234f4a7bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:19.801623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e878e-6394-43a2-bbf8-8d234f4a7bab None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:19.815795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 401/784] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:19.817256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e878e-6394-43a2-bbf8-8d234f4a7bab None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:19.831854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 384/785] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:19.834233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470bdf4-64d1-453e-864c-ecce12d8951a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:19.936474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:19.962948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470bdf4-64d1-453e-864c-ecce12d8951a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:19.970943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e878e-6394-43a2-bbf8-8d234f4a7bab None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:19.973521 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:20.009660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ec05-c3dd-4ec3-9e24-4ae1c53b1de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:20.010508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ec05-c3dd-4ec3-9e24-4ae1c53b1de5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.010867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ec05-c3dd-4ec3-9e24-4ae1c53b1de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.011144 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ec05-c3dd-4ec3-9e24-4ae1c53b1de5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.013939 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e3bb7-a760-4687-9c2a-0ad9fe060567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:20.015194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e3bb7-a760-4687-9c2a-0ad9fe060567 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.015694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e3bb7-a760-4687-9c2a-0ad9fe060567 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.016216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e3bb7-a760-4687-9c2a-0ad9fe060567 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.019589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ec05-c3dd-4ec3-9e24-4ae1c53b1de5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:20.021062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ec05-c3dd-4ec3-9e24-4ae1c53b1de5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:20.025936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e3bb7-a760-4687-9c2a-0ad9fe060567 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:20.027927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e3bb7-a760-4687-9c2a-0ad9fe060567 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5cf4ec05-c3dd-4ec3-9e24-4ae1c53b1de5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:20.033940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:20.034902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:20.035781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:20.035781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:20.035781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:20.035781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:20.035781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:20.035781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:20.035781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:20.035781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:20.040226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 402/786] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:20.041009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ec05-c3dd-4ec3-9e24-4ae1c53b1de5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-6b9e3bb7-a760-4687-9c2a-0ad9fe060567 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:20.051490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:20.053724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 385/787] 10.222.0.55 () {56 vars in 1117 bytes} [Mon Jul 25 22:45:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:20.056521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e3bb7-a760-4687-9c2a-0ad9fe060567 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:20.213958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e3bb7-a760-4687-9c2a-0ad9fe060567 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:20.255542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87635b08-aaa6-4801-9bd4-8dce6f43369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:20.256177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87635b08-aaa6-4801-9bd4-8dce6f43369e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.256460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87635b08-aaa6-4801-9bd4-8dce6f43369e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.256727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87635b08-aaa6-4801-9bd4-8dce6f43369e None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.257524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87635b08-aaa6-4801-9bd4-8dce6f43369e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:20.257858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87635b08-aaa6-4801-9bd4-8dce6f43369e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:20.259282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87635b08-aaa6-4801-9bd4-8dce6f43369e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:20.261862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ec05-c3dd-4ec3-9e24-4ae1c53b1de5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:20.271645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:20.275903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 386/788] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:20.276689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87635b08-aaa6-4801-9bd4-8dce6f43369e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:20.308133 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:20.327989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb5d1f-c08f-40c9-b640-80eafc9cb31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:20.329076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb5d1f-c08f-40c9-b640-80eafc9cb31b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.329597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb5d1f-c08f-40c9-b640-80eafc9cb31b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.330056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb5d1f-c08f-40c9-b640-80eafc9cb31b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.352189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb5d1f-c08f-40c9-b640-80eafc9cb31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-1afb5d1f-c08f-40c9-b640-80eafc9cb31b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:20.359427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:20.360487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:20.361522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 403/789] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:20.370076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a3ae-1f98-4152-a429-c7938f090539 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.370076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a3ae-1f98-4152-a429-c7938f090539 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.370076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a3ae-1f98-4152-a429-c7938f090539 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.371178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 404/790] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:20.371517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1a3ae-1f98-4152-a429-c7938f090539 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:20.424118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87635b08-aaa6-4801-9bd4-8dce6f43369e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:20.477540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb402c-5e30-4c67-b102-6c11b564284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:20.478483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb402c-5e30-4c67-b102-6c11b564284c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.478926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb402c-5e30-4c67-b102-6c11b564284c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.479362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb402c-5e30-4c67-b102-6c11b564284c None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.480344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb402c-5e30-4c67-b102-6c11b564284c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:20.480652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb402c-5e30-4c67-b102-6c11b564284c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:20.482157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb402c-5e30-4c67-b102-6c11b564284c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:20.501826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 387/791] 10.222.0.55 () {56 vars in 1149 bytes} [Mon Jul 25 22:45:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:20.506922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb402c-5e30-4c67-b102-6c11b564284c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:20.515925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1a3ae-1f98-4152-a429-c7938f090539 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:20.565186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c708555-b76b-4e7b-811b-909f593076d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:20.566736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c708555-b76b-4e7b-811b-909f593076d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.567159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c708555-b76b-4e7b-811b-909f593076d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.567607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c708555-b76b-4e7b-811b-909f593076d4 None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/eea60163008a4bea95d130a5809fc50d/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.570319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c708555-b76b-4e7b-811b-909f593076d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=eea60163008a4bea95d130a5809fc50d, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:20.572025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c708555-b76b-4e7b-811b-909f593076d4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:20.602164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:20.660866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 405/792] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:45:20 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/eea60163008a4bea95d130a5809fc50d/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:45:20.662733 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64aad8-a656-4c03-a13e-222f84953d5b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.663063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64aad8-a656-4c03-a13e-222f84953d5b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.663379 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64aad8-a656-4c03-a13e-222f84953d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.697208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb402c-5e30-4c67-b102-6c11b564284c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:20.701662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0d64aad8-a656-4c03-a13e-222f84953d5b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:20.703788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0d64aad8-a656-4c03-a13e-222f84953d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:20.774966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953041-27ea-4b2e-9bf1-9a226b4c5487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:20.776503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953041-27ea-4b2e-9bf1-9a226b4c5487 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.777326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953041-27ea-4b2e-9bf1-9a226b4c5487 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.777797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953041-27ea-4b2e-9bf1-9a226b4c5487 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.779119 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad953041-27ea-4b2e-9bf1-9a226b4c5487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:20.779622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad953041-27ea-4b2e-9bf1-9a226b4c5487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:20.782207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad953041-27ea-4b2e-9bf1-9a226b4c5487 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:20.794114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:20.802906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 388/793] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:20.809385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953041-27ea-4b2e-9bf1-9a226b4c5487 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:20.852030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 406/794] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:20.852973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64aad8-a656-4c03-a13e-222f84953d5b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:20.999137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64aad8-a656-4c03-a13e-222f84953d5b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:21.020580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953041-27ea-4b2e-9bf1-9a226b4c5487 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:21.040247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3e51f-902c-4546-830c-6e90d9ec5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:21.041022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e51f-902c-4546-830c-6e90d9ec5936 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.041345 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e51f-902c-4546-830c-6e90d9ec5936 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.041619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e51f-902c-4546-830c-6e90d9ec5936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.054056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3e51f-902c-4546-830c-6e90d9ec5936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:21.055690 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3e51f-902c-4546-830c-6e90d9ec5936 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:21.062899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-30e3e51f-902c-4546-830c-6e90d9ec5936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:21.073551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:21.083578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:21.084498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:21.084498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:21.084498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:21.084498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:21.084498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 407/795] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:21.084498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3e51f-902c-4546-830c-6e90d9ec5936 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:21.090246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f5ceb-7ca3-43c9-9b3b-0a9e884aa76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:21.091496 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5ceb-7ca3-43c9-9b3b-0a9e884aa76e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.091990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5ceb-7ca3-43c9-9b3b-0a9e884aa76e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.092481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5ceb-7ca3-43c9-9b3b-0a9e884aa76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.114935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f5ceb-7ca3-43c9-9b3b-0a9e884aa76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:21.117724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f5ceb-7ca3-43c9-9b3b-0a9e884aa76e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:21.118516 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-fd7f5ceb-7ca3-43c9-9b3b-0a9e884aa76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:21.146978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:21.148531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:21.149566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:21.149566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:21.149566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:21.149566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:21.151501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 389/796] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:21.152869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f5ceb-7ca3-43c9-9b3b-0a9e884aa76e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:21.213795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3e51f-902c-4546-830c-6e90d9ec5936 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:21.259627 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2222a95-7c33-4df1-8075-d7085046f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:21.260411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2222a95-7c33-4df1-8075-d7085046f023 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.260877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2222a95-7c33-4df1-8075-d7085046f023 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.261063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2222a95-7c33-4df1-8075-d7085046f023 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.261742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2222a95-7c33-4df1-8075-d7085046f023 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:21.263264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2222a95-7c33-4df1-8075-d7085046f023 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:21.274566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f5ceb-7ca3-43c9-9b3b-0a9e884aa76e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a2222a95-7c33-4df1-8075-d7085046f023 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:21.276366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:21.283099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:21.285042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 408/797] 10.222.0.55 () {56 vars in 1129 bytes} [Mon Jul 25 22:45:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:21.286141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2222a95-7c33-4df1-8075-d7085046f023 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:21.327240 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31651-abd2-443c-b571-88d6600a6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:21.327878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31651-abd2-443c-b571-88d6600a6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.328324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31651-abd2-443c-b571-88d6600a6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.328821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31651-abd2-443c-b571-88d6600a6ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.331627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b31651-abd2-443c-b571-88d6600a6ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:21.332206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b31651-abd2-443c-b571-88d6600a6ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:21.334410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b31651-abd2-443c-b571-88d6600a6ae9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:21.357262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 390/798] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:21.357262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31651-abd2-443c-b571-88d6600a6ae9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:21.415478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:21.441148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:21.448686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2222a95-7c33-4df1-8075-d7085046f023 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:21.490104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f28889-cb9c-4350-97f4-b171c44b289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:21.490104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f28889-cb9c-4350-97f4-b171c44b289e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.490104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f28889-cb9c-4350-97f4-b171c44b289e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.490104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f28889-cb9c-4350-97f4-b171c44b289e None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.490811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f28889-cb9c-4350-97f4-b171c44b289e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:21.490811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f28889-cb9c-4350-97f4-b171c44b289e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:21.493058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f28889-cb9c-4350-97f4-b171c44b289e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:21.511102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 409/799] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:21.512177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f28889-cb9c-4350-97f4-b171c44b289e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:21.520192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31651-abd2-443c-b571-88d6600a6ae9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:21.588037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b8c1d-f18e-43b6-b9a0-671445cbc570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:21.589562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8c1d-f18e-43b6-b9a0-671445cbc570 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.590338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8c1d-f18e-43b6-b9a0-671445cbc570 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.591113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8c1d-f18e-43b6-b9a0-671445cbc570 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.592647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b8c1d-f18e-43b6-b9a0-671445cbc570 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:21.593514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b8c1d-f18e-43b6-b9a0-671445cbc570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:21.597267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b8c1d-f18e-43b6-b9a0-671445cbc570 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:21.613247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 391/800] 10.222.0.55 () {56 vars in 1124 bytes} [Mon Jul 25 22:45:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:21.615284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b8c1d-f18e-43b6-b9a0-671445cbc570 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:21.634655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f28889-cb9c-4350-97f4-b171c44b289e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:21.674477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378d59-2047-4b5d-823b-c9426583136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:21.675176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378d59-2047-4b5d-823b-c9426583136f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.675465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378d59-2047-4b5d-823b-c9426583136f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.675740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378d59-2047-4b5d-823b-c9426583136f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.684954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378d59-2047-4b5d-823b-c9426583136f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:21.685428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378d59-2047-4b5d-823b-c9426583136f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4f378d59-2047-4b5d-823b-c9426583136f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:21.698035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:21.699858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:21.701764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:21.701764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:21.701764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:21.701764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:21.701764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:21.701764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:21.701764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:21.701764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:21.701764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:45:21.701764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:21.704436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 410/801] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:45:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:21.705204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378d59-2047-4b5d-823b-c9426583136f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:21.723866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:21.807074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:21.817631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b8c1d-f18e-43b6-b9a0-671445cbc570 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:21.821751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378d59-2047-4b5d-823b-c9426583136f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:21.868558 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0379da-5f90-4eb6-a576-ba5f0ec301b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:21.869293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0379da-5f90-4eb6-a576-ba5f0ec301b2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.869580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0379da-5f90-4eb6-a576-ba5f0ec301b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.869848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0379da-5f90-4eb6-a576-ba5f0ec301b2 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.870540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0379da-5f90-4eb6-a576-ba5f0ec301b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:21.870846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0379da-5f90-4eb6-a576-ba5f0ec301b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:21.872283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0379da-5f90-4eb6-a576-ba5f0ec301b2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:21.885166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 411/802] 10.222.0.55 () {56 vars in 1124 bytes} [Mon Jul 25 22:45:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:21.885166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0379da-5f90-4eb6-a576-ba5f0ec301b2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:21.886594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3122607-c045-47b1-92a3-e876df4bc373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:21.887233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122607-c045-47b1-92a3-e876df4bc373 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.887588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122607-c045-47b1-92a3-e876df4bc373 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.887940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122607-c045-47b1-92a3-e876df4bc373 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.899100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3122607-c045-47b1-92a3-e876df4bc373 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:21.901430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3122607-c045-47b1-92a3-e876df4bc373 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-e3122607-c045-47b1-92a3-e876df4bc373 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:21.913697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:21.914874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:21.915815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:21.915815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:21.915815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:21.915815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:21.915815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:21.915815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:21.915815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:21.915815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:21.915815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 392/803] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:21.916410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017471c-39f8-4087-97e5-27160caee461 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.916694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017471c-39f8-4087-97e5-27160caee461 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.916972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017471c-39f8-4087-97e5-27160caee461 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.921162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 393/804] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:21.921162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017471c-39f8-4087-97e5-27160caee461 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:21.992942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:22.016529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0379da-5f90-4eb6-a576-ba5f0ec301b2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:22.050962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017471c-39f8-4087-97e5-27160caee461 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:22.058097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25abbd7-90da-4aaf-b80d-6ff7179b06e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:22.058724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abbd7-90da-4aaf-b80d-6ff7179b06e5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:22.059084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abbd7-90da-4aaf-b80d-6ff7179b06e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:22.059290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abbd7-90da-4aaf-b80d-6ff7179b06e5 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:22.060095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25abbd7-90da-4aaf-b80d-6ff7179b06e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:22.060399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25abbd7-90da-4aaf-b80d-6ff7179b06e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:22.061982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25abbd7-90da-4aaf-b80d-6ff7179b06e5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:22.080270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 412/805] 10.222.0.55 () {56 vars in 1135 bytes} [Mon Jul 25 22:45:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:22.083247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25abbd7-90da-4aaf-b80d-6ff7179b06e5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:22.090697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888a152-29fb-4029-a74f-7fc5017ea6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:22.091582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a152-29fb-4029-a74f-7fc5017ea6a4 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:22.091582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a152-29fb-4029-a74f-7fc5017ea6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:22.091899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a152-29fb-4029-a74f-7fc5017ea6a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:22.092571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888a152-29fb-4029-a74f-7fc5017ea6a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:22.093991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888a152-29fb-4029-a74f-7fc5017ea6a4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:22.197810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25abbd7-90da-4aaf-b80d-6ff7179b06e5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:22.234554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 394/806] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 22:45:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:22.236698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5eedc-a015-415a-b624-a61f6ded8c22 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:22.237461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5eedc-a015-415a-b624-a61f6ded8c22 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:22.237949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5eedc-a015-415a-b624-a61f6ded8c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:22.253895 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:22.256540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0c91c-8d2e-42ee-a4d2-60edf34e88fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:22.257363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0c91c-8d2e-42ee-a4d2-60edf34e88fd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:22.257652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0c91c-8d2e-42ee-a4d2-60edf34e88fd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:22.257949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0c91c-8d2e-42ee-a4d2-60edf34e88fd None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:22.258915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0c91c-8d2e-42ee-a4d2-60edf34e88fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:22.259867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0c91c-8d2e-42ee-a4d2-60edf34e88fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:22.262324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0c91c-8d2e-42ee-a4d2-60edf34e88fd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:22.265846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c2c5eedc-a015-415a-b624-a61f6ded8c22 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:22.267819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c2c5eedc-a015-415a-b624-a61f6ded8c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:22.278465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:22.293660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 413/807] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:22.295155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0c91c-8d2e-42ee-a4d2-60edf34e88fd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:22.378225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 395/808] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:22.379807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5eedc-a015-415a-b624-a61f6ded8c22 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:22.525340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0c91c-8d2e-42ee-a4d2-60edf34e88fd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:22.573609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5eedc-a015-415a-b624-a61f6ded8c22 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:22.576217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201a34-ed9f-4e6f-9718-6439909853f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:22.577201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201a34-ed9f-4e6f-9718-6439909853f6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:22.577650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201a34-ed9f-4e6f-9718-6439909853f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:22.578238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201a34-ed9f-4e6f-9718-6439909853f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:22.595647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0201a34-ed9f-4e6f-9718-6439909853f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:22.598117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0201a34-ed9f-4e6f-9718-6439909853f6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:22.614998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72436cb-b361-47c0-824e-76743f429b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:22.615808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72436cb-b361-47c0-824e-76743f429b0c None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:22.616224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72436cb-b361-47c0-824e-76743f429b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:22.616607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72436cb-b361-47c0-824e-76743f429b0c None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/508186f65cac4ab6b4643d0255725c41/roles/7b381eede31e433d8686d9ffae1da02c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-c0201a34-ed9f-4e6f-9718-6439909853f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:22.624651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:22.625926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:22.626829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:22.626829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:22.626829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:22.626829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:22.629976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 414/809] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:22.631218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201a34-ed9f-4e6f-9718-6439909853f6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:22.632183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:22.635765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72436cb-b361-47c0-824e-76743f429b0c None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=508186f65cac4ab6b4643d0255725c41, role_id=7b381eede31e433d8686d9ffae1da02c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:22.637638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72436cb-b361-47c0-824e-76743f429b0c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:22.689313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:22.730108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 396/810] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:45:22 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/508186f65cac4ab6b4643d0255725c41/roles/7b381eede31e433d8686d9ffae1da02c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:45:22.731641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72436cb-b361-47c0-824e-76743f429b0c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:22.761061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201a34-ed9f-4e6f-9718-6439909853f6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:22.843311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a6dd2-3706-4f82-a41e-d2d3ccec1a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:22.843836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a6dd2-3706-4f82-a41e-d2d3ccec1a2b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:22.844150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a6dd2-3706-4f82-a41e-d2d3ccec1a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:22.844437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a6dd2-3706-4f82-a41e-d2d3ccec1a2b None admin] PATH_INFO: `/v3/services/network` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:22.845092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a6dd2-3706-4f82-a41e-d2d3ccec1a2b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:22.847310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a6dd2-3706-4f82-a41e-d2d3ccec1a2b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-901a6dd2-3706-4f82-a41e-d2d3ccec1a2b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:22.871618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:22.872729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:22.873764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 415/811] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:22 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:22.879000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a6dd2-3706-4f82-a41e-d2d3ccec1a2b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:22.887166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72436cb-b361-47c0-824e-76743f429b0c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:22.939402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a1883-14fe-413d-bc35-637475b9c767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:22.940533 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a1883-14fe-413d-bc35-637475b9c767 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:22.941030 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a1883-14fe-413d-bc35-637475b9c767 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:22.941873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a1883-14fe-413d-bc35-637475b9c767 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:22.943512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a1883-14fe-413d-bc35-637475b9c767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:22.944277 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a1883-14fe-413d-bc35-637475b9c767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:22.946773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a1883-14fe-413d-bc35-637475b9c767 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:22.965814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 397/812] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:22.967098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f36873-3cf2-4b40-8581-4021193f11c7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:22.967609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f36873-3cf2-4b40-8581-4021193f11c7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:22.967719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f36873-3cf2-4b40-8581-4021193f11c7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:22.969448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 398/813] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:22.973971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f36873-3cf2-4b40-8581-4021193f11c7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:23.048115 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:23.062975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a6dd2-3706-4f82-a41e-d2d3ccec1a2b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:23.075659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:23.112107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422815c1-52b8-492d-8b9d-d9f58ce5cebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:23.113026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422815c1-52b8-492d-8b9d-d9f58ce5cebf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.113430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422815c1-52b8-492d-8b9d-d9f58ce5cebf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.113795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422815c1-52b8-492d-8b9d-d9f58ce5cebf None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.114705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422815c1-52b8-492d-8b9d-d9f58ce5cebf None admin] RBAC: Adding query filter params (name=network) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:23.115112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422815c1-52b8-492d-8b9d-d9f58ce5cebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:23.116762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422815c1-52b8-492d-8b9d-d9f58ce5cebf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:23.119498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f36873-3cf2-4b40-8581-4021193f11c7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:23.122563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 416/814] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:23.128973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c8082-ebc5-41cc-813b-6fe88d482ff3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.129353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c8082-ebc5-41cc-813b-6fe88d482ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.129770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c8082-ebc5-41cc-813b-6fe88d482ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.151359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-735c8082-ebc5-41cc-813b-6fe88d482ff3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:23.152951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-735c8082-ebc5-41cc-813b-6fe88d482ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:23.170164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bee4bf-6c36-439a-bae4-e448b1a201fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:23.171587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee4bf-6c36-439a-bae4-e448b1a201fb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.172035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee4bf-6c36-439a-bae4-e448b1a201fb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.172789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee4bf-6c36-439a-bae4-e448b1a201fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.183223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bee4bf-6c36-439a-bae4-e448b1a201fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:23.185925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bee4bf-6c36-439a-bae4-e448b1a201fb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-07bee4bf-6c36-439a-bae4-e448b1a201fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:23.203344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:23.204460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:23.205494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:23.205494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:23.205494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:23.205494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:23.205494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:23.205494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:23.205494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:23.205494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:23.210652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 399/815] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:23.211723 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bee4bf-6c36-439a-bae4-e448b1a201fb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:23.253229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 417/816] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:23.254591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c8082-ebc5-41cc-813b-6fe88d482ff3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:23.356890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bee4bf-6c36-439a-bae4-e448b1a201fb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:23.374487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:23.394730 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c8082-ebc5-41cc-813b-6fe88d482ff3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:23.397579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:23.404789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0825-ebaf-4bf8-ad0a-aac80b801437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:23.405717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0825-ebaf-4bf8-ad0a-aac80b801437 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.406167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0825-ebaf-4bf8-ad0a-aac80b801437 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.406605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0825-ebaf-4bf8-ad0a-aac80b801437 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.407438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef0825-ebaf-4bf8-ad0a-aac80b801437 None admin] RBAC: Adding query filter params (type=network) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:23.407888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef0825-ebaf-4bf8-ad0a-aac80b801437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:23.411568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef0825-ebaf-4bf8-ad0a-aac80b801437 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:23.419251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 400/817] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:23.420431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0825-ebaf-4bf8-ad0a-aac80b801437 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:23.458302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df047e2e-4a0c-43b6-bb23-ef25a3a69a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:23.459238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df047e2e-4a0c-43b6-bb23-ef25a3a69a2a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.459734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df047e2e-4a0c-43b6-bb23-ef25a3a69a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.460263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df047e2e-4a0c-43b6-bb23-ef25a3a69a2a None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.461111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df047e2e-4a0c-43b6-bb23-ef25a3a69a2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:23.461616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df047e2e-4a0c-43b6-bb23-ef25a3a69a2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:23.463802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df047e2e-4a0c-43b6-bb23-ef25a3a69a2a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:23.483622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 418/818] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:23.485055 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df047e2e-4a0c-43b6-bb23-ef25a3a69a2a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:23.552664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0825-ebaf-4bf8-ad0a-aac80b801437 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:23.593835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f9c79-2ae8-41fd-ba9c-9f7750102b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:23.594722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f9c79-2ae8-41fd-ba9c-9f7750102b32 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.595073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f9c79-2ae8-41fd-ba9c-9f7750102b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.595425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f9c79-2ae8-41fd-ba9c-9f7750102b32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.609677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f9c79-2ae8-41fd-ba9c-9f7750102b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-518f9c79-2ae8-41fd-ba9c-9f7750102b32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:23.616431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:23.617486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:23.618305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:23.619355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df047e2e-4a0c-43b6-bb23-ef25a3a69a2a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:23.623299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 401/819] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:23.624434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f9c79-2ae8-41fd-ba9c-9f7750102b32 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:23.658544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178c6d1-c1ed-479d-a19a-05e57583d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:23.661007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178c6d1-c1ed-479d-a19a-05e57583d9a7 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.661313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178c6d1-c1ed-479d-a19a-05e57583d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.661587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178c6d1-c1ed-479d-a19a-05e57583d9a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.662573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178c6d1-c1ed-479d-a19a-05e57583d9a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:23.664692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178c6d1-c1ed-479d-a19a-05e57583d9a7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:23.668123 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:23.739228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f9c79-2ae8-41fd-ba9c-9f7750102b32 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:23.775410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a3d1-0451-4e65-8114-98d70695c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:23.776046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a3d1-0451-4e65-8114-98d70695c7db None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.776305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a3d1-0451-4e65-8114-98d70695c7db None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.776588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a3d1-0451-4e65-8114-98d70695c7db None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/6db67b0bfa2a4c0f84fad07ac144b7bd/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.778722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062a3d1-0451-4e65-8114-98d70695c7db None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=6db67b0bfa2a4c0f84fad07ac144b7bd, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:23.780373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062a3d1-0451-4e65-8114-98d70695c7db None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:23.787075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 419/820] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 22:45:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:23.788250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178c6d1-c1ed-479d-a19a-05e57583d9a7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:23.814355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:23.889326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 402/821] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:45:23 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/6db67b0bfa2a4c0f84fad07ac144b7bd/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:45:23.921855 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178c6d1-c1ed-479d-a19a-05e57583d9a7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:23.965200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19961b22-6b70-41fd-917d-695f3dad1d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:23.965847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961b22-6b70-41fd-917d-695f3dad1d83 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.966124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961b22-6b70-41fd-917d-695f3dad1d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.966402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961b22-6b70-41fd-917d-695f3dad1d83 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.967136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19961b22-6b70-41fd-917d-695f3dad1d83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:23.967435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19961b22-6b70-41fd-917d-695f3dad1d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:23.968841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19961b22-6b70-41fd-917d-695f3dad1d83 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:23.980348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 420/822] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:23.986220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a3d1-0451-4e65-8114-98d70695c7db None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:24.108909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:24.115944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a3d1-0451-4e65-8114-98d70695c7db None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:24.153805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649bb91-a43f-4640-8151-212c6f77a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:24.155259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649bb91-a43f-4640-8151-212c6f77a029 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:24.156184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649bb91-a43f-4640-8151-212c6f77a029 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:24.156385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649bb91-a43f-4640-8151-212c6f77a029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:24.168404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649bb91-a43f-4640-8151-212c6f77a029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:24.169920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649bb91-a43f-4640-8151-212c6f77a029 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-0649bb91-a43f-4640-8151-212c6f77a029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:24.186752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:24.187685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:24.188574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:24.188574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:24.188574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:24.188574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:24.188574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 403/823] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:24.194100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19961b22-6b70-41fd-917d-695f3dad1d83 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:24.283787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:24.310720 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19961b22-6b70-41fd-917d-695f3dad1d83 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:24.348825 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67616894-bb72-4f45-b620-0ce01f80c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:24.349484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67616894-bb72-4f45-b620-0ce01f80c649 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:24.349766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67616894-bb72-4f45-b620-0ce01f80c649 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:24.350033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67616894-bb72-4f45-b620-0ce01f80c649 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:24.350734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67616894-bb72-4f45-b620-0ce01f80c649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:24.351037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67616894-bb72-4f45-b620-0ce01f80c649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:24.352424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67616894-bb72-4f45-b620-0ce01f80c649 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:24.366270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 421/824] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:24.371857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649bb91-a43f-4640-8151-212c6f77a029 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:24.482951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649bb91-a43f-4640-8151-212c6f77a029 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:24.521604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab94d-ab17-4103-84d0-090b6e306caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:24.522638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab94d-ab17-4103-84d0-090b6e306caf None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:24.523121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab94d-ab17-4103-84d0-090b6e306caf None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:24.523590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab94d-ab17-4103-84d0-090b6e306caf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:24.532655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab94d-ab17-4103-84d0-090b6e306caf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:24.534737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab94d-ab17-4103-84d0-090b6e306caf None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-797ab94d-ab17-4103-84d0-090b6e306caf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:24.547641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:24.548657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:24.550146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:24.550146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:24.550146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:24.550146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:24.550146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:24.550146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:24.550146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:24.550146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:24.550146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:45:24.550146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:24.553470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 404/825] 10.222.0.55 () {56 vars in 1093 bytes} [Mon Jul 25 22:45:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:24.561989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67616894-bb72-4f45-b620-0ce01f80c649 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:24.676969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67616894-bb72-4f45-b620-0ce01f80c649 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:24.715909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759f838-bd9c-44ab-9c25-472df814f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:24.716942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759f838-bd9c-44ab-9c25-472df814f012 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:24.717465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759f838-bd9c-44ab-9c25-472df814f012 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:24.717932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759f838-bd9c-44ab-9c25-472df814f012 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:24.718951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759f838-bd9c-44ab-9c25-472df814f012 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:24.719472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759f838-bd9c-44ab-9c25-472df814f012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:24.721111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759f838-bd9c-44ab-9c25-472df814f012 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:24.724707 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:24.743175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 422/826] 10.222.0.55 () {56 vars in 1133 bytes} [Mon Jul 25 22:45:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:24.749152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab94d-ab17-4103-84d0-090b6e306caf None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:24.763828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:24.788524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef283-4899-4114-a69e-8244f47db01c None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:24.789218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef283-4899-4114-a69e-8244f47db01c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:24.789713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef283-4899-4114-a69e-8244f47db01c None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:24.791542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 423/827] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:24.797304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca549c3-2953-4a85-bbb8-7547347fc8cb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:24.797950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca549c3-2953-4a85-bbb8-7547347fc8cb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:24.798428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca549c3-2953-4a85-bbb8-7547347fc8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:24.818626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-fca549c3-2953-4a85-bbb8-7547347fc8cb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:24.820195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fca549c3-2953-4a85-bbb8-7547347fc8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:24.876514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab94d-ab17-4103-84d0-090b6e306caf None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:24.913332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 424/828] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:24.922101 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d6fc-2d18-4bc9-b2d9-0b577b2a0223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:24.922729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d6fc-2d18-4bc9-b2d9-0b577b2a0223 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:24.923046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d6fc-2d18-4bc9-b2d9-0b577b2a0223 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:24.923322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d6fc-2d18-4bc9-b2d9-0b577b2a0223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:24.940288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca549c3-2953-4a85-bbb8-7547347fc8cb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:25.018082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d6fc-2d18-4bc9-b2d9-0b577b2a0223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:25.021017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d6fc-2d18-4bc9-b2d9-0b577b2a0223 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:25.033537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:25.075354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca549c3-2953-4a85-bbb8-7547347fc8cb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:25.107133 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:25.121439 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f1d3b-c4ae-41b3-8403-fdf2f0304e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:25.122632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f1d3b-c4ae-41b3-8403-fdf2f0304e1d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.122632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f1d3b-c4ae-41b3-8403-fdf2f0304e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.122789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f1d3b-c4ae-41b3-8403-fdf2f0304e1d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.123377 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f1d3b-c4ae-41b3-8403-fdf2f0304e1d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:25.124774 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f1d3b-c4ae-41b3-8403-fdf2f0304e1d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-616f1d3b-c4ae-41b3-8403-fdf2f0304e1d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:25.134853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:25.136852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:25.138396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 425/829] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:45:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:25.142157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaefc29-e2f0-4910-a85b-24f1acf9ac42 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.142157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaefc29-e2f0-4910-a85b-24f1acf9ac42 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.142157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaefc29-e2f0-4910-a85b-24f1acf9ac42 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.142157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 426/830] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:25.146152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92853-ffd2-437d-bf4e-b617dc616742 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.146639 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92853-ffd2-437d-bf4e-b617dc616742 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.147131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92853-ffd2-437d-bf4e-b617dc616742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.168677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 405/831] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:45:25.168677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d6fc-2d18-4bc9-b2d9-0b577b2a0223 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:25.176097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6bd92853-ffd2-437d-bf4e-b617dc616742 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:25.177609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6bd92853-ffd2-437d-bf4e-b617dc616742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:25.280736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d6fc-2d18-4bc9-b2d9-0b577b2a0223 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:25.292620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:25.301367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 427/832] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:25.301367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92853-ffd2-437d-bf4e-b617dc616742 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:25.326961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49253724-3e6b-49ad-99b5-e39f7c10be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:25.327878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49253724-3e6b-49ad-99b5-e39f7c10be85 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.328306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49253724-3e6b-49ad-99b5-e39f7c10be85 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.328772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49253724-3e6b-49ad-99b5-e39f7c10be85 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.330070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49253724-3e6b-49ad-99b5-e39f7c10be85 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:25.331049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49253724-3e6b-49ad-99b5-e39f7c10be85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:25.333395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49253724-3e6b-49ad-99b5-e39f7c10be85 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:25.338956 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 406/833] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:45:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:25.339839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49253724-3e6b-49ad-99b5-e39f7c10be85 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:25.434659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92853-ffd2-437d-bf4e-b617dc616742 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:25.453890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:25.459150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49253724-3e6b-49ad-99b5-e39f7c10be85 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:25.474716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e322-3d37-4abc-8124-e37c40a37134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:25.475382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e322-3d37-4abc-8124-e37c40a37134 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.476476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e322-3d37-4abc-8124-e37c40a37134 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.476476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e322-3d37-4abc-8124-e37c40a37134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.490212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990e322-3d37-4abc-8124-e37c40a37134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:25.491753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990e322-3d37-4abc-8124-e37c40a37134 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5990e322-3d37-4abc-8124-e37c40a37134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:25.509991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:25.511039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:25.511928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:25.511928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:25.511928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:25.511928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:25.512783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc7f4f-2de0-4421-b4c8-2b466a8d121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:25.512783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc7f4f-2de0-4421-b4c8-2b466a8d121f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.512783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc7f4f-2de0-4421-b4c8-2b466a8d121f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.512783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc7f4f-2de0-4421-b4c8-2b466a8d121f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.513273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 428/834] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:25.513273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e322-3d37-4abc-8124-e37c40a37134 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:25.529075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc7f4f-2de0-4421-b4c8-2b466a8d121f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-63fc7f4f-2de0-4421-b4c8-2b466a8d121f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:25.534727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:25.535931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:45:25.536817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:25.541285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 407/835] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:25.542248 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc7f4f-2de0-4421-b4c8-2b466a8d121f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:25.579806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:25.637680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e322-3d37-4abc-8124-e37c40a37134 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:25.672107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc7f4f-2de0-4421-b4c8-2b466a8d121f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:25.677838 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f8259-3f84-463c-b226-a3c491d12164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:25.678744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f8259-3f84-463c-b226-a3c491d12164 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.679222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f8259-3f84-463c-b226-a3c491d12164 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.679676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f8259-3f84-463c-b226-a3c491d12164 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.680574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f8259-3f84-463c-b226-a3c491d12164 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:25.681074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f8259-3f84-463c-b226-a3c491d12164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:25.682554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f8259-3f84-463c-b226-a3c491d12164 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:25.689526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 429/836] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:45:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:25.694924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f8259-3f84-463c-b226-a3c491d12164 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:25.725786 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07511528-fdaa-4460-bb99-27362988f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:25.727625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07511528-fdaa-4460-bb99-27362988f693 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.728155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07511528-fdaa-4460-bb99-27362988f693 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.728921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07511528-fdaa-4460-bb99-27362988f693 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.730337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07511528-fdaa-4460-bb99-27362988f693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:25.731435 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07511528-fdaa-4460-bb99-27362988f693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:25.733544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07511528-fdaa-4460-bb99-27362988f693 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:25.743360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:25.754977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 408/837] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:25.761103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07511528-fdaa-4460-bb99-27362988f693 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:25.860594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f8259-3f84-463c-b226-a3c491d12164 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:25.915837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd568ba-5c1d-4208-9c9e-ff47ac8a7fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:25.917299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd568ba-5c1d-4208-9c9e-ff47ac8a7fef None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.918032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd568ba-5c1d-4208-9c9e-ff47ac8a7fef None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.918796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd568ba-5c1d-4208-9c9e-ff47ac8a7fef None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.920505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd568ba-5c1d-4208-9c9e-ff47ac8a7fef None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:25.921339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd568ba-5c1d-4208-9c9e-ff47ac8a7fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:25.924047 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd568ba-5c1d-4208-9c9e-ff47ac8a7fef None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:25.926507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:25.943435 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07511528-fdaa-4460-bb99-27362988f693 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:25.944640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 430/838] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:25.953946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd568ba-5c1d-4208-9c9e-ff47ac8a7fef None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:26.002036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52c6f1-17f0-4506-8eef-96f852ee3236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:26.002888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52c6f1-17f0-4506-8eef-96f852ee3236 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.003295 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52c6f1-17f0-4506-8eef-96f852ee3236 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.003669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52c6f1-17f0-4506-8eef-96f852ee3236 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.013991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52c6f1-17f0-4506-8eef-96f852ee3236 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:26.015787 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52c6f1-17f0-4506-8eef-96f852ee3236 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-5b52c6f1-17f0-4506-8eef-96f852ee3236 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:26.030926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:26.031899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:26.032899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:26.032899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:26.032899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:26.032899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:26.032899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:26.032899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:26.032899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:26.032899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:26.037246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 409/839] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:26.038896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52c6f1-17f0-4506-8eef-96f852ee3236 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:26.108614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:26.116343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd568ba-5c1d-4208-9c9e-ff47ac8a7fef None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:26.167360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d82dec-13f3-4874-beb0-1567278ae9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:26.168050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d82dec-13f3-4874-beb0-1567278ae9ff None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.168497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d82dec-13f3-4874-beb0-1567278ae9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.169044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d82dec-13f3-4874-beb0-1567278ae9ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.183407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d82dec-13f3-4874-beb0-1567278ae9ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:26.184919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d82dec-13f3-4874-beb0-1567278ae9ff None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:26.199719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52c6f1-17f0-4506-8eef-96f852ee3236 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b9d82dec-13f3-4874-beb0-1567278ae9ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:26.201785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:26.202684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:26.203557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:26.203557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:26.203557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:26.203557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:26.208238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 431/840] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:26.209591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d82dec-13f3-4874-beb0-1567278ae9ff None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:26.254772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81ed29-92ed-4538-978b-cb853ae85c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:26.255447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81ed29-92ed-4538-978b-cb853ae85c3a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.255729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81ed29-92ed-4538-978b-cb853ae85c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.256008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81ed29-92ed-4538-978b-cb853ae85c3a None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.256830 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81ed29-92ed-4538-978b-cb853ae85c3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:26.257262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81ed29-92ed-4538-978b-cb853ae85c3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:26.258846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81ed29-92ed-4538-978b-cb853ae85c3a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:26.280218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 410/841] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:26.282604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81ed29-92ed-4538-978b-cb853ae85c3a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:26.300996 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:26.353195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d82dec-13f3-4874-beb0-1567278ae9ff None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:26.402710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7f6aa-3945-4b77-927c-0203ea5dd769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:26.404363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7f6aa-3945-4b77-927c-0203ea5dd769 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.404856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7f6aa-3945-4b77-927c-0203ea5dd769 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.405382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7f6aa-3945-4b77-927c-0203ea5dd769 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.406248 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81ed29-92ed-4538-978b-cb853ae85c3a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:26.406498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7f6aa-3945-4b77-927c-0203ea5dd769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:26.407014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7f6aa-3945-4b77-927c-0203ea5dd769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:26.410248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7f6aa-3945-4b77-927c-0203ea5dd769 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:26.432501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 432/842] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:26.433578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7f6aa-3945-4b77-927c-0203ea5dd769 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:26.446744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:26.455446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798c3b1-36b3-4123-bf2c-a7a6fd0f94e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:26.457190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798c3b1-36b3-4123-bf2c-a7a6fd0f94e4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.457690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798c3b1-36b3-4123-bf2c-a7a6fd0f94e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.458164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798c3b1-36b3-4123-bf2c-a7a6fd0f94e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.459719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798c3b1-36b3-4123-bf2c-a7a6fd0f94e4 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=eea60163008a4bea95d130a5809fc50d) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:26.460262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798c3b1-36b3-4123-bf2c-a7a6fd0f94e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:26.462519 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798c3b1-36b3-4123-bf2c-a7a6fd0f94e4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:26.469832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 411/843] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:26 2022] GET /identity/v3/role_assignments?user.id=eea60163008a4bea95d130a5809fc50d&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:26.472024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeb8ad-1c3e-4b82-a904-facf3bb57141 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.472477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeb8ad-1c3e-4b82-a904-facf3bb57141 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.472932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeb8ad-1c3e-4b82-a904-facf3bb57141 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.474540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 412/844] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:26.480621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb3a70-9cd3-44ca-86b6-aa65e003be61 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.480942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb3a70-9cd3-44ca-86b6-aa65e003be61 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.481227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb3a70-9cd3-44ca-86b6-aa65e003be61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.504003 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-37eb3a70-9cd3-44ca-86b6-aa65e003be61 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:26.505359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-37eb3a70-9cd3-44ca-86b6-aa65e003be61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:26.570065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7f6aa-3945-4b77-927c-0203ea5dd769 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:26.597900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 413/845] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:26.613747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad33e8-4a0c-4efb-9003-3ff390bcd350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:26.614901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad33e8-4a0c-4efb-9003-3ff390bcd350 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.615427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad33e8-4a0c-4efb-9003-3ff390bcd350 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.615913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad33e8-4a0c-4efb-9003-3ff390bcd350 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.617326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb3a70-9cd3-44ca-86b6-aa65e003be61 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:26.625565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad33e8-4a0c-4efb-9003-3ff390bcd350 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:26.626583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:26.629697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad33e8-4a0c-4efb-9003-3ff390bcd350 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-14ad33e8-4a0c-4efb-9003-3ff390bcd350 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:26.644802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:26.652647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:26.653705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 433/846] 10.222.0.55 () {56 vars in 1117 bytes} [Mon Jul 25 22:45:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:26.655598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad33e8-4a0c-4efb-9003-3ff390bcd350 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:26.744302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:26.746649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb3a70-9cd3-44ca-86b6-aa65e003be61 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:26.792487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bee19-2f8c-4d9e-8bed-2050b505dab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:26.792879 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bee19-2f8c-4d9e-8bed-2050b505dab9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.793188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bee19-2f8c-4d9e-8bed-2050b505dab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.793473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bee19-2f8c-4d9e-8bed-2050b505dab9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.801440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad33e8-4a0c-4efb-9003-3ff390bcd350 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:26.813194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bee19-2f8c-4d9e-8bed-2050b505dab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-776bee19-2f8c-4d9e-8bed-2050b505dab9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:26.824884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:26.826228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:45:26.827261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:26.835337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 414/847] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:26.837001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bee19-2f8c-4d9e-8bed-2050b505dab9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:26.853167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f96e4-64a4-4575-97b4-d96eb76654f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:26.854337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f96e4-64a4-4575-97b4-d96eb76654f2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.854846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f96e4-64a4-4575-97b4-d96eb76654f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.855334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f96e4-64a4-4575-97b4-d96eb76654f2 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.856485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f96e4-64a4-4575-97b4-d96eb76654f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:26.857028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f96e4-64a4-4575-97b4-d96eb76654f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:26.858817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f96e4-64a4-4575-97b4-d96eb76654f2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:26.890362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 434/848] 10.222.0.55 () {56 vars in 1149 bytes} [Mon Jul 25 22:45:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:26.900311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f96e4-64a4-4575-97b4-d96eb76654f2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:26.951981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:27.014456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bee19-2f8c-4d9e-8bed-2050b505dab9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:27.058479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f96e4-64a4-4575-97b4-d96eb76654f2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:27.076626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeb489-17c7-45ee-8569-f6537fb3cced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:27.077831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeb489-17c7-45ee-8569-f6537fb3cced None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:27.078846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeb489-17c7-45ee-8569-f6537fb3cced None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:27.079334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeb489-17c7-45ee-8569-f6537fb3cced None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:27.080700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eeb489-17c7-45ee-8569-f6537fb3cced None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:27.081796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eeb489-17c7-45ee-8569-f6537fb3cced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:27.083774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eeb489-17c7-45ee-8569-f6537fb3cced None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:27.094760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:27.102475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 415/849] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:27.106833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeb489-17c7-45ee-8569-f6537fb3cced None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:27.115196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27207db-5dda-4a42-9239-5fa9f854c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:27.116355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27207db-5dda-4a42-9239-5fa9f854c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:27.116886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27207db-5dda-4a42-9239-5fa9f854c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:27.117281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27207db-5dda-4a42-9239-5fa9f854c4c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:27.216818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27207db-5dda-4a42-9239-5fa9f854c4c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:27.219293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27207db-5dda-4a42-9239-5fa9f854c4c9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:27.249871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeb489-17c7-45ee-8569-f6537fb3cced None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:27.280777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:27.291393 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbd27f-aed0-4de2-9615-96d5f3dad2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:27.292119 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbd27f-aed0-4de2-9615-96d5f3dad2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:27.292401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbd27f-aed0-4de2-9615-96d5f3dad2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:27.295753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbd27f-aed0-4de2-9615-96d5f3dad2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:27.306082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbd27f-aed0-4de2-9615-96d5f3dad2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:27.308050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbd27f-aed0-4de2-9615-96d5f3dad2a2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-17fbd27f-aed0-4de2-9615-96d5f3dad2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:27.325669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:27.326700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:27.327597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:27.327597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:27.327597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:27.327597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:27.330132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 416/850] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:27.336731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbd27f-aed0-4de2-9615-96d5f3dad2a2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:27.367242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 435/851] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:45:27.368602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27207db-5dda-4a42-9239-5fa9f854c4c9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:27.400410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:27.483254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbd27f-aed0-4de2-9615-96d5f3dad2a2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:27.510059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27207db-5dda-4a42-9239-5fa9f854c4c9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:27.530839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b483479-a677-4e51-9235-a079bccd499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:27.531815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b483479-a677-4e51-9235-a079bccd499c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:27.532293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b483479-a677-4e51-9235-a079bccd499c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:27.532828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b483479-a677-4e51-9235-a079bccd499c None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:27.533829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b483479-a677-4e51-9235-a079bccd499c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:27.535476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b483479-a677-4e51-9235-a079bccd499c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:27.537189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b483479-a677-4e51-9235-a079bccd499c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:27.553271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 417/852] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:27.558914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b483479-a677-4e51-9235-a079bccd499c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:27.560701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70515fc2-9918-4e8c-884d-2292255505ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:27.561622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70515fc2-9918-4e8c-884d-2292255505ab None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:27.562101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70515fc2-9918-4e8c-884d-2292255505ab None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:27.562585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70515fc2-9918-4e8c-884d-2292255505ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:27.575811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70515fc2-9918-4e8c-884d-2292255505ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:27.579102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70515fc2-9918-4e8c-884d-2292255505ab None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-70515fc2-9918-4e8c-884d-2292255505ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:27.598519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:27.599486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:27.600366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:27.600366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:27.600366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:27.600366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:27.602379 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 436/853] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:27.613177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70515fc2-9918-4e8c-884d-2292255505ab None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:27.613520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:27.697040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b483479-a677-4e51-9235-a079bccd499c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:27.701504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:27.729291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70515fc2-9918-4e8c-884d-2292255505ab None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:27.745835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8008d-b07d-4de6-9c1a-6afd7b1a15cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:27.746425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8008d-b07d-4de6-9c1a-6afd7b1a15cf None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:27.746711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8008d-b07d-4de6-9c1a-6afd7b1a15cf None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:27.746988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8008d-b07d-4de6-9c1a-6afd7b1a15cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:27.761434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8008d-b07d-4de6-9c1a-6afd7b1a15cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:27.762920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8008d-b07d-4de6-9c1a-6afd7b1a15cf None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b8d8008d-b07d-4de6-9c1a-6afd7b1a15cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:27.780785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:27.781990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:27.782942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:27.782942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:27.782942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:27.782942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:27.782942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:27.782942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:27.782942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:27.782942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:27.782942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:45:27.782942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:27.785198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 418/854] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:45:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:27.788714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1157dd-e0d7-4c7d-8a2e-5e1f8800a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:27.789418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1157dd-e0d7-4c7d-8a2e-5e1f8800a46e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:27.789705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1157dd-e0d7-4c7d-8a2e-5e1f8800a46e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:27.790049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1157dd-e0d7-4c7d-8a2e-5e1f8800a46e None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:27.790784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1157dd-e0d7-4c7d-8a2e-5e1f8800a46e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:27.791081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8008d-b07d-4de6-9c1a-6afd7b1a15cf None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:27.791211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1157dd-e0d7-4c7d-8a2e-5e1f8800a46e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:27.792590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1157dd-e0d7-4c7d-8a2e-5e1f8800a46e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:27.817177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 437/855] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:27.822212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1157dd-e0d7-4c7d-8a2e-5e1f8800a46e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:27.925675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:27.933323 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8008d-b07d-4de6-9c1a-6afd7b1a15cf None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:27.953328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1157dd-e0d7-4c7d-8a2e-5e1f8800a46e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:27.985852 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aaf8d-1052-45a1-9700-86d9dc2899c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:27.986498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aaf8d-1052-45a1-9700-86d9dc2899c9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:27.986784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aaf8d-1052-45a1-9700-86d9dc2899c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:27.987616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aaf8d-1052-45a1-9700-86d9dc2899c9 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:27.988463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aaf8d-1052-45a1-9700-86d9dc2899c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:27.988773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aaf8d-1052-45a1-9700-86d9dc2899c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:27.990335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aaf8d-1052-45a1-9700-86d9dc2899c9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:28.004803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6793904-be63-4eae-8380-279fb3576960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:28.005529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793904-be63-4eae-8380-279fb3576960 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.005890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793904-be63-4eae-8380-279fb3576960 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.006232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793904-be63-4eae-8380-279fb3576960 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.015872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 419/856] 10.222.0.55 () {56 vars in 1135 bytes} [Mon Jul 25 22:45:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:28.017300 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aaf8d-1052-45a1-9700-86d9dc2899c9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:28.020163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6793904-be63-4eae-8380-279fb3576960 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:28.023105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6793904-be63-4eae-8380-279fb3576960 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:28.025303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-d6793904-be63-4eae-8380-279fb3576960 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:28.039839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:28.040993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:28.042137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:28.042137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:28.042137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:28.042137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:28.042137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:28.042137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:28.042137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:28.042137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:28.044752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 438/857] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:28.046534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cab72-28e1-4a88-a048-c488ccbf1037 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.046980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cab72-28e1-4a88-a048-c488ccbf1037 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.047548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cab72-28e1-4a88-a048-c488ccbf1037 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.050088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 439/858] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:28.055881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cab72-28e1-4a88-a048-c488ccbf1037 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:28.150582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aaf8d-1052-45a1-9700-86d9dc2899c9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:28.195598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cab72-28e1-4a88-a048-c488ccbf1037 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:28.202307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8af185-01b6-406e-bb0c-967980222200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:28.202935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8af185-01b6-406e-bb0c-967980222200 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.203216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8af185-01b6-406e-bb0c-967980222200 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.203490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8af185-01b6-406e-bb0c-967980222200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.254206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b210c0d-d374-46f5-b6cd-493f30acf195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:28.255226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b210c0d-d374-46f5-b6cd-493f30acf195 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.255620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b210c0d-d374-46f5-b6cd-493f30acf195 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.256481 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b210c0d-d374-46f5-b6cd-493f30acf195 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.256601 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:28.257351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b210c0d-d374-46f5-b6cd-493f30acf195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:28.257852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b210c0d-d374-46f5-b6cd-493f30acf195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:28.260132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b210c0d-d374-46f5-b6cd-493f30acf195 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:28.285262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 440/859] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:28.285262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b83c6-69cb-4505-afe8-d36d474c1b48 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.285262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b83c6-69cb-4505-afe8-d36d474c1b48 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.285262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b83c6-69cb-4505-afe8-d36d474c1b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.309583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c96b83c6-69cb-4505-afe8-d36d474c1b48 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:28.309583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c96b83c6-69cb-4505-afe8-d36d474c1b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:28.330479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8af185-01b6-406e-bb0c-967980222200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:28.332469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8af185-01b6-406e-bb0c-967980222200 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:28.380727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:28.405155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 441/860] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:28.405155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b83c6-69cb-4505-afe8-d36d474c1b48 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:28.511907 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 420/861] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:45:28.513202 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8af185-01b6-406e-bb0c-967980222200 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:28.563533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b83c6-69cb-4505-afe8-d36d474c1b48 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:28.608335 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f56c-259f-45ea-9311-e3a0eca51fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:28.608985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f56c-259f-45ea-9311-e3a0eca51fed None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.609311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f56c-259f-45ea-9311-e3a0eca51fed None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.609554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f56c-259f-45ea-9311-e3a0eca51fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.610361 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f56c-259f-45ea-9311-e3a0eca51fed None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=508186f65cac4ab6b4643d0255725c41) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:28.610673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f56c-259f-45ea-9311-e3a0eca51fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:28.612708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f56c-259f-45ea-9311-e3a0eca51fed None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:28.625165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 442/862] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:28 2022] GET /identity/v3/role_assignments?user.id=508186f65cac4ab6b4643d0255725c41&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:28.625165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f56c-259f-45ea-9311-e3a0eca51fed None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:28.630825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:28.684684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8af185-01b6-406e-bb0c-967980222200 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:28.700229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:28.736751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85f07-2184-43a5-81bc-a460510bf011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:28.737782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85f07-2184-43a5-81bc-a460510bf011 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.738143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85f07-2184-43a5-81bc-a460510bf011 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.738494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85f07-2184-43a5-81bc-a460510bf011 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.739319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85f07-2184-43a5-81bc-a460510bf011 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:28.740934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85f07-2184-43a5-81bc-a460510bf011 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:28.775717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f56c-259f-45ea-9311-e3a0eca51fed None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:28.817142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74bfb6-8cf7-4a17-b3dc-f90359e1c423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:28.817811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74bfb6-8cf7-4a17-b3dc-f90359e1c423 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.818097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74bfb6-8cf7-4a17-b3dc-f90359e1c423 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.818377 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74bfb6-8cf7-4a17-b3dc-f90359e1c423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.830993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74bfb6-8cf7-4a17-b3dc-f90359e1c423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:28.832677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74bfb6-8cf7-4a17-b3dc-f90359e1c423 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-df74bfb6-8cf7-4a17-b3dc-f90359e1c423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:28.850360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:28.851338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:28.852235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:28.852235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:28.852235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:28.852235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:28.852235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 443/863] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:28.856522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed025b0f-d8ad-4fe3-ab93-83321a2ae5e9 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.856522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed025b0f-d8ad-4fe3-ab93-83321a2ae5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.856522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed025b0f-d8ad-4fe3-ab93-83321a2ae5e9 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.857374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 421/864] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:45:28 2022] POST /identity/v3/services => generated 251 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:28.858408 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85f07-2184-43a5-81bc-a460510bf011 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:28.860475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 444/865] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:28.863002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948035b-d6b9-4108-bf1d-8b006405632d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.863166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948035b-d6b9-4108-bf1d-8b006405632d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.863488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948035b-d6b9-4108-bf1d-8b006405632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.887952 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1948035b-d6b9-4108-bf1d-8b006405632d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:28.889293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1948035b-d6b9-4108-bf1d-8b006405632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:29.012340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 445/866] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:29.027941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85f07-2184-43a5-81bc-a460510bf011 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:29.036033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948035b-d6b9-4108-bf1d-8b006405632d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:29.064486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:29.092163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167e4d2-5568-47fb-9b16-86b3686a4f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:29.092789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167e4d2-5568-47fb-9b16-86b3686a4f83 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:29.093077 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167e4d2-5568-47fb-9b16-86b3686a4f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:29.093405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167e4d2-5568-47fb-9b16-86b3686a4f83 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:29.093562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:29.094104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167e4d2-5568-47fb-9b16-86b3686a4f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:29.094407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167e4d2-5568-47fb-9b16-86b3686a4f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:29.095891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167e4d2-5568-47fb-9b16-86b3686a4f83 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:29.112172 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 422/867] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:29.127514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167e4d2-5568-47fb-9b16-86b3686a4f83 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:29.195494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948035b-d6b9-4108-bf1d-8b006405632d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:29.242553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd601b-b63d-4f53-9cb3-64cf881514ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:29.243225 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd601b-b63d-4f53-9cb3-64cf881514ee None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:29.243529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd601b-b63d-4f53-9cb3-64cf881514ee None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:29.244039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd601b-b63d-4f53-9cb3-64cf881514ee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:29.245150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd601b-b63d-4f53-9cb3-64cf881514ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:29.246562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd601b-b63d-4f53-9cb3-64cf881514ee None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b8fd601b-b63d-4f53-9cb3-64cf881514ee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:29.258432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:29.259638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:45:29.260686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:29.262077 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 446/868] 10.222.0.55 () {56 vars in 1132 bytes} [Mon Jul 25 22:45:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:29.268011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd601b-b63d-4f53-9cb3-64cf881514ee None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:29.274345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167e4d2-5568-47fb-9b16-86b3686a4f83 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:29.328514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565349-6189-42ff-bcb6-b37b6a05ef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:29.329280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565349-6189-42ff-bcb6-b37b6a05ef0b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:29.329564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565349-6189-42ff-bcb6-b37b6a05ef0b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:29.329838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565349-6189-42ff-bcb6-b37b6a05ef0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:29.339594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d565349-6189-42ff-bcb6-b37b6a05ef0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:29.341726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d565349-6189-42ff-bcb6-b37b6a05ef0b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-8d565349-6189-42ff-bcb6-b37b6a05ef0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:29.358892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:29.360491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:29.361898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:29.361898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:29.361898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:29.361898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:29.361898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:29.361898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:29.361898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:29.361898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:29.366797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 423/869] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:29.370383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565349-6189-42ff-bcb6-b37b6a05ef0b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:29.421376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:29.432173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:29.439172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd601b-b63d-4f53-9cb3-64cf881514ee None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:29.475548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5589f-ce0a-4537-a75e-170d6daa8a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:29.476584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5589f-ce0a-4537-a75e-170d6daa8a64 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:29.477103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5589f-ce0a-4537-a75e-170d6daa8a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:29.477619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5589f-ce0a-4537-a75e-170d6daa8a64 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:29.478509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5589f-ce0a-4537-a75e-170d6daa8a64 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:29.479016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5589f-ce0a-4537-a75e-170d6daa8a64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:29.480599 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5589f-ce0a-4537-a75e-170d6daa8a64 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:29.486456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 447/870] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:29.496247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5589f-ce0a-4537-a75e-170d6daa8a64 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:29.504802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565349-6189-42ff-bcb6-b37b6a05ef0b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:29.547203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ad868-2246-4baa-8c9f-633447b543d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:29.548536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ad868-2246-4baa-8c9f-633447b543d9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:29.549025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ad868-2246-4baa-8c9f-633447b543d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:29.550134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ad868-2246-4baa-8c9f-633447b543d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:29.552002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ad868-2246-4baa-8c9f-633447b543d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:29.552502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ad868-2246-4baa-8c9f-633447b543d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:29.554419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ad868-2246-4baa-8c9f-633447b543d9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:29.576322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 424/871] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:29.577968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ad868-2246-4baa-8c9f-633447b543d9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:29.625715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5589f-ce0a-4537-a75e-170d6daa8a64 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:29.676981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4b61a-697b-427d-aea1-5bb03f71dbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:29.678142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b61a-697b-427d-aea1-5bb03f71dbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:29.678626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b61a-697b-427d-aea1-5bb03f71dbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:29.679104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b61a-697b-427d-aea1-5bb03f71dbf3 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:29.680053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4b61a-697b-427d-aea1-5bb03f71dbf3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:29.680600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4b61a-697b-427d-aea1-5bb03f71dbf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:29.684116 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4b61a-697b-427d-aea1-5bb03f71dbf3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:29.699887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 448/872] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:29.718143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:29.727614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ad868-2246-4baa-8c9f-633447b543d9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:29.771857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b488-8e94-485b-8351-7a0a77c14afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:29.772498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b488-8e94-485b-8351-7a0a77c14afd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:29.772782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b488-8e94-485b-8351-7a0a77c14afd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:29.773144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b488-8e94-485b-8351-7a0a77c14afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:29.773983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b488-8e94-485b-8351-7a0a77c14afd None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=6db67b0bfa2a4c0f84fad07ac144b7bd) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:29.774295 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b488-8e94-485b-8351-7a0a77c14afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:29.775843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b488-8e94-485b-8351-7a0a77c14afd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:29.783601 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 425/873] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:29 2022] GET /identity/v3/role_assignments?user.id=6db67b0bfa2a4c0f84fad07ac144b7bd&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:31.048571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44992cf0-7061-4620-baf5-d39cd57f76ae None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.049105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44992cf0-7061-4620-baf5-d39cd57f76ae None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.049105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44992cf0-7061-4620-baf5-d39cd57f76ae None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.051073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 449/874] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:31.057596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207fc69-920c-43a1-a468-09154f966cec None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.058124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207fc69-920c-43a1-a468-09154f966cec None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.058124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207fc69-920c-43a1-a468-09154f966cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.078895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c207fc69-920c-43a1-a468-09154f966cec None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:31.080528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c207fc69-920c-43a1-a468-09154f966cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:31.165065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 426/875] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:31.188573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44992cf0-7061-4620-baf5-d39cd57f76ae None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:31.219176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:31.254551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f38b3-699e-4f4b-a73e-4347f2cdcd1a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.254910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f38b3-699e-4f4b-a73e-4347f2cdcd1a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.255094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f38b3-699e-4f4b-a73e-4347f2cdcd1a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.256749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 427/876] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:31.267147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0b72-f88c-4ea0-bc88-de4d37f87663 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.268714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0b72-f88c-4ea0-bc88-de4d37f87663 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.269521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0b72-f88c-4ea0-bc88-de4d37f87663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.292708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1adf0b72-f88c-4ea0-bc88-de4d37f87663 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:31.294479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1adf0b72-f88c-4ea0-bc88-de4d37f87663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:31.314086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44992cf0-7061-4620-baf5-d39cd57f76ae None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:31.355158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1a04-2a09-4e24-b8c5-910f3724fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:31.355836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1a04-2a09-4e24-b8c5-910f3724fa2d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.356115 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1a04-2a09-4e24-b8c5-910f3724fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.356387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1a04-2a09-4e24-b8c5-910f3724fa2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.370915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb1a04-2a09-4e24-b8c5-910f3724fa2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-adfb1a04-2a09-4e24-b8c5-910f3724fa2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:31.376504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:31.378398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:45:31.379739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:31.382259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 450/877] 10.222.0.55 () {56 vars in 1120 bytes} [Mon Jul 25 22:45:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:31.389282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1a04-2a09-4e24-b8c5-910f3724fa2d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:31.389626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 428/878] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:31.407695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf0b72-f88c-4ea0-bc88-de4d37f87663 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:31.434805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:31.499643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:31.522515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1a04-2a09-4e24-b8c5-910f3724fa2d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:31.525768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf0b72-f88c-4ea0-bc88-de4d37f87663 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:31.563323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702cd69-5dda-421a-b812-91089cbf58aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:31.563966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702cd69-5dda-421a-b812-91089cbf58aa None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.564245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702cd69-5dda-421a-b812-91089cbf58aa None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.564518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702cd69-5dda-421a-b812-91089cbf58aa None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.566029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702cd69-5dda-421a-b812-91089cbf58aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:31.566816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702cd69-5dda-421a-b812-91089cbf58aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:31.568407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702cd69-5dda-421a-b812-91089cbf58aa None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:31.568708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762df00-faf7-4558-beff-73557ec9f944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:31.569634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762df00-faf7-4558-beff-73557ec9f944 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.570110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762df00-faf7-4558-beff-73557ec9f944 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.570583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762df00-faf7-4558-beff-73557ec9f944 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.571415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762df00-faf7-4558-beff-73557ec9f944 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:31.573030 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762df00-faf7-4558-beff-73557ec9f944 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:31.578800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 451/879] 10.222.0.55 () {56 vars in 1115 bytes} [Mon Jul 25 22:45:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-a762df00-faf7-4558-beff-73557ec9f944 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:31.583968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:31.585037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:45:31.585911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:31.586652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702cd69-5dda-421a-b812-91089cbf58aa None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:31.593434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 429/880] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:45:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:31.596841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762df00-faf7-4558-beff-73557ec9f944 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:31.695998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:31.714224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762df00-faf7-4558-beff-73557ec9f944 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:31.714426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702cd69-5dda-421a-b812-91089cbf58aa None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:31.752312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546db8ae-e5e8-4bba-ae23-400eb435ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:31.753983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546db8ae-e5e8-4bba-ae23-400eb435ece3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.754096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4e1bf-14ea-4436-83b4-612e9717b906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:31.754614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546db8ae-e5e8-4bba-ae23-400eb435ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.754743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4e1bf-14ea-4436-83b4-612e9717b906 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.755017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4e1bf-14ea-4436-83b4-612e9717b906 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.755289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4e1bf-14ea-4436-83b4-612e9717b906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.755633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546db8ae-e5e8-4bba-ae23-400eb435ece3 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.756535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546db8ae-e5e8-4bba-ae23-400eb435ece3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:31.757057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546db8ae-e5e8-4bba-ae23-400eb435ece3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:31.758683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546db8ae-e5e8-4bba-ae23-400eb435ece3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:31.770603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4e1bf-14ea-4436-83b4-612e9717b906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:31.770603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4e1bf-14ea-4436-83b4-612e9717b906 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:31.771353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 430/881] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:45:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:31.773402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546db8ae-e5e8-4bba-ae23-400eb435ece3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:31.781559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-3fa4e1bf-14ea-4436-83b4-612e9717b906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:31.790095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:31.791949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:31.792854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:31.792854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:31.792854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:31.792854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:31.792854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 452/882] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:31.798284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4e1bf-14ea-4436-83b4-612e9717b906 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:31.913162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546db8ae-e5e8-4bba-ae23-400eb435ece3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:31.926561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4e1bf-14ea-4436-83b4-612e9717b906 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:31.961744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c98282-cc50-484a-927a-132b7dee0b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:31.962293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c98282-cc50-484a-927a-132b7dee0b42 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.962574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c98282-cc50-484a-927a-132b7dee0b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.962851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c98282-cc50-484a-927a-132b7dee0b42 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.963540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c98282-cc50-484a-927a-132b7dee0b42 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:31.963848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c98282-cc50-484a-927a-132b7dee0b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:31.965285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c98282-cc50-484a-927a-132b7dee0b42 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:31.968710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ab2e1-e576-4562-b2d6-6fe7979923b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:31.969576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ab2e1-e576-4562-b2d6-6fe7979923b7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.970022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ab2e1-e576-4562-b2d6-6fe7979923b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.970444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ab2e1-e576-4562-b2d6-6fe7979923b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.970774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 431/883] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:45:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:31.972025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ab2e1-e576-4562-b2d6-6fe7979923b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:31.972470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ab2e1-e576-4562-b2d6-6fe7979923b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:31.973106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957d0e9-a1fc-453c-a36d-59786e594458 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.973425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957d0e9-a1fc-453c-a36d-59786e594458 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.973703 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957d0e9-a1fc-453c-a36d-59786e594458 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.974643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ab2e1-e576-4562-b2d6-6fe7979923b7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:31.979447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 432/884] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:31.980802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2339b-d252-4ae1-9632-d56133ac8216 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.981093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2339b-d252-4ae1-9632-d56133ac8216 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.981398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2339b-d252-4ae1-9632-d56133ac8216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.993358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 453/885] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:31.993358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ab2e1-e576-4562-b2d6-6fe7979923b7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:32.001145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-94d2339b-d252-4ae1-9632-d56133ac8216 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:32.002575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-94d2339b-d252-4ae1-9632-d56133ac8216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:32.013517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:32.059456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:32.079708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 433/886] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:32.081853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2339b-d252-4ae1-9632-d56133ac8216 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:32.120545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ab2e1-e576-4562-b2d6-6fe7979923b7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:32.166790 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcab275-3f0d-4db9-abd8-dd48c52fafac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:32.167719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcab275-3f0d-4db9-abd8-dd48c52fafac None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:32.167998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcab275-3f0d-4db9-abd8-dd48c52fafac None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:32.168274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcab275-3f0d-4db9-abd8-dd48c52fafac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:32.169041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcab275-3f0d-4db9-abd8-dd48c52fafac None admin] RBAC: Adding query filter params (interface=public, service_id=4bd246bf5e0a4d1f833bfb0c1cfe87a4, region_id=RegionOne) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:32.169381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcab275-3f0d-4db9-abd8-dd48c52fafac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:32.170755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcab275-3f0d-4db9-abd8-dd48c52fafac None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:32.178927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 454/887] 10.222.0.55 () {56 vars in 1251 bytes} [Mon Jul 25 22:45:31 2022] GET /identity/v3/endpoints?service_id=4bd246bf5e0a4d1f833bfb0c1cfe87a4&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:32.180213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fb6a9-408b-4c2a-818e-09e572dd373d None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:32.180502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fb6a9-408b-4c2a-818e-09e572dd373d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:32.181239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fb6a9-408b-4c2a-818e-09e572dd373d None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:32.186989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 455/888] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:32.186989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fb6a9-408b-4c2a-818e-09e572dd373d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:32.193725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2339b-d252-4ae1-9632-d56133ac8216 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:32.230001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa985600-1450-4cd3-bb77-9ffab4e8580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:32.230569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa985600-1450-4cd3-bb77-9ffab4e8580c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:32.230854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa985600-1450-4cd3-bb77-9ffab4e8580c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:32.231131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa985600-1450-4cd3-bb77-9ffab4e8580c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:32.238370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa985600-1450-4cd3-bb77-9ffab4e8580c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:32.239832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa985600-1450-4cd3-bb77-9ffab4e8580c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-fa985600-1450-4cd3-bb77-9ffab4e8580c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:32.259423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:32.260510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 434/889] 10.222.0.55 () {56 vars in 1117 bytes} [Mon Jul 25 22:45:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:32.266214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa985600-1450-4cd3-bb77-9ffab4e8580c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:32.271189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:32.302839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fb6a9-408b-4c2a-818e-09e572dd373d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:32.324255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:32.339631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343470a5-b8c4-4dfe-9047-402ef5372c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:32.340246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343470a5-b8c4-4dfe-9047-402ef5372c4b None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:32.340524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343470a5-b8c4-4dfe-9047-402ef5372c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:32.340797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343470a5-b8c4-4dfe-9047-402ef5372c4b None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:32.341539 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343470a5-b8c4-4dfe-9047-402ef5372c4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:32.343062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343470a5-b8c4-4dfe-9047-402ef5372c4b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:32.389143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa985600-1450-4cd3-bb77-9ffab4e8580c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:32.410993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 456/890] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:45:32 2022] POST /identity/v3/services => generated 269 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:32.412511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb061cfd-174e-4a1d-aeac-8b7b7da2d1e7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:32.412981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb061cfd-174e-4a1d-aeac-8b7b7da2d1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:32.413433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb061cfd-174e-4a1d-aeac-8b7b7da2d1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:32.435178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d04a9-6156-4176-90d3-c4769b2f24a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:32.435418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-cb061cfd-174e-4a1d-aeac-8b7b7da2d1e7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:32.435821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d04a9-6156-4176-90d3-c4769b2f24a3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:32.436102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d04a9-6156-4176-90d3-c4769b2f24a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:32.436377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d04a9-6156-4176-90d3-c4769b2f24a3 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:32.437053 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d04a9-6156-4176-90d3-c4769b2f24a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:32.437603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cb061cfd-174e-4a1d-aeac-8b7b7da2d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:32.438505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d04a9-6156-4176-90d3-c4769b2f24a3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:32.449627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 435/891] 10.222.0.55 () {56 vars in 1087 bytes} [Mon Jul 25 22:45:32 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:45:32.450948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d04a9-6156-4176-90d3-c4769b2f24a3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:32.553772 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 457/892] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:32.574786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb061cfd-174e-4a1d-aeac-8b7b7da2d1e7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:32.597377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:32.651378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d04a9-6156-4176-90d3-c4769b2f24a3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:32.692478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b9d52-89d6-4435-b87a-d69ad3148359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:32.693237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b9d52-89d6-4435-b87a-d69ad3148359 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:32.693523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b9d52-89d6-4435-b87a-d69ad3148359 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:32.693800 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b9d52-89d6-4435-b87a-d69ad3148359 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:32.694738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b9d52-89d6-4435-b87a-d69ad3148359 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:32.695049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b9d52-89d6-4435-b87a-d69ad3148359 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:32.696733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b9d52-89d6-4435-b87a-d69ad3148359 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:32.702469 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb061cfd-174e-4a1d-aeac-8b7b7da2d1e7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:32.716938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:32.722149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 436/893] 10.222.0.55 () {56 vars in 1149 bytes} [Mon Jul 25 22:45:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:32.728810 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b9d52-89d6-4435-b87a-d69ad3148359 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:32.747786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5c570-19a6-47da-a46d-ba7832b32782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:32.748447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c570-19a6-47da-a46d-ba7832b32782 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:32.748732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c570-19a6-47da-a46d-ba7832b32782 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:32.749006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c570-19a6-47da-a46d-ba7832b32782 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:32.749728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5c570-19a6-47da-a46d-ba7832b32782 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:32.751258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5c570-19a6-47da-a46d-ba7832b32782 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-e0d5c570-19a6-47da-a46d-ba7832b32782 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:32.763536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:32.769917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:32.771222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 458/894] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:32.773581 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5c570-19a6-47da-a46d-ba7832b32782 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:32.905207 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5c570-19a6-47da-a46d-ba7832b32782 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:32.905514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b9d52-89d6-4435-b87a-d69ad3148359 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:32.932714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:32.946642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f6fd4-31ae-4ed1-bc07-4bdd28069162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:32.947488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f6fd4-31ae-4ed1-bc07-4bdd28069162 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:32.947917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f6fd4-31ae-4ed1-bc07-4bdd28069162 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:32.948339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f6fd4-31ae-4ed1-bc07-4bdd28069162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:32.949426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c48d3-65a4-4f9b-b2bb-246c45ae85c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:32.950002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c48d3-65a4-4f9b-b2bb-246c45ae85c5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:32.950357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c48d3-65a4-4f9b-b2bb-246c45ae85c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:32.950628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c48d3-65a4-4f9b-b2bb-246c45ae85c5 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:32.951365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c48d3-65a4-4f9b-b2bb-246c45ae85c5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:32.951641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c48d3-65a4-4f9b-b2bb-246c45ae85c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:32.953842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c48d3-65a4-4f9b-b2bb-246c45ae85c5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:32.963925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 459/895] 10.222.0.55 () {56 vars in 1122 bytes} [Mon Jul 25 22:45:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:32.964873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c48d3-65a4-4f9b-b2bb-246c45ae85c5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:33.007965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:33.031741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f6fd4-31ae-4ed1-bc07-4bdd28069162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:33.033538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f6fd4-31ae-4ed1-bc07-4bdd28069162 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:33.078290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c48d3-65a4-4f9b-b2bb-246c45ae85c5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:33.117706 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f14ec-cbd6-49a6-9c39-c98195f51969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:33.117948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f14ec-cbd6-49a6-9c39-c98195f51969 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:33.118234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f14ec-cbd6-49a6-9c39-c98195f51969 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:33.118509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f14ec-cbd6-49a6-9c39-c98195f51969 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:33.119204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f14ec-cbd6-49a6-9c39-c98195f51969 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:33.119512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f14ec-cbd6-49a6-9c39-c98195f51969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:33.120916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f14ec-cbd6-49a6-9c39-c98195f51969 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:33.126527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 460/896] 10.222.0.55 () {56 vars in 1122 bytes} [Mon Jul 25 22:45:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:33.155567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 437/897] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:32 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:45:33.165696 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f14ec-cbd6-49a6-9c39-c98195f51969 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:33.307101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f14ec-cbd6-49a6-9c39-c98195f51969 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:33.321496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:33.367684 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0431a-efec-4db2-af78-ba1e6cd81e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:33.368443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0431a-efec-4db2-af78-ba1e6cd81e2d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:33.368686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0431a-efec-4db2-af78-ba1e6cd81e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:33.368967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0431a-efec-4db2-af78-ba1e6cd81e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:33.385095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0431a-efec-4db2-af78-ba1e6cd81e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:33.386695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0431a-efec-4db2-af78-ba1e6cd81e2d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7fa0431a-efec-4db2-af78-ba1e6cd81e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:33.405812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:33.406880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:33.407803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:33.407803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:33.407803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:33.407803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:33.408032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 461/898] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:33.413979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f6fd4-31ae-4ed1-bc07-4bdd28069162 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:33.441169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:33.539453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f6fd4-31ae-4ed1-bc07-4bdd28069162 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:33.591027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60197726-ba27-48b1-8917-7a9f44ee5f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:33.591659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60197726-ba27-48b1-8917-7a9f44ee5f57 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:33.592043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60197726-ba27-48b1-8917-7a9f44ee5f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:33.592339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60197726-ba27-48b1-8917-7a9f44ee5f57 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:33.593114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60197726-ba27-48b1-8917-7a9f44ee5f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:33.593448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60197726-ba27-48b1-8917-7a9f44ee5f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:33.594919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60197726-ba27-48b1-8917-7a9f44ee5f57 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:33.611356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 438/899] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:33.617960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0431a-efec-4db2-af78-ba1e6cd81e2d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:33.751359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0431a-efec-4db2-af78-ba1e6cd81e2d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:33.792358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c9b8-e276-41b0-a0da-5306e355ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:33.793025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c9b8-e276-41b0-a0da-5306e355ecd8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:33.793340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c9b8-e276-41b0-a0da-5306e355ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:33.793618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c9b8-e276-41b0-a0da-5306e355ecd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:33.802009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c9b8-e276-41b0-a0da-5306e355ecd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:33.803483 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c9b8-e276-41b0-a0da-5306e355ecd8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-9306c9b8-e276-41b0-a0da-5306e355ecd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:33.816373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:33.818109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:33.819795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:33.819795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:33.819795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:33.819795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:33.819795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:33.819795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:33.819795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:33.819795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:33.819795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 462/900] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:33.831915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60197726-ba27-48b1-8917-7a9f44ee5f57 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:33.989400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:34.013062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60197726-ba27-48b1-8917-7a9f44ee5f57 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:34.069517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef358a25-8922-42c1-84ad-b9d4969c8e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:34.070168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef358a25-8922-42c1-84ad-b9d4969c8e0a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:34.070452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef358a25-8922-42c1-84ad-b9d4969c8e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:34.070759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef358a25-8922-42c1-84ad-b9d4969c8e0a None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:34.071626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef358a25-8922-42c1-84ad-b9d4969c8e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:34.071950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef358a25-8922-42c1-84ad-b9d4969c8e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:34.073531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef358a25-8922-42c1-84ad-b9d4969c8e0a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:34.090211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 439/901] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:34.096738 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c9b8-e276-41b0-a0da-5306e355ecd8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:34.130996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:34.211727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c9b8-e276-41b0-a0da-5306e355ecd8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:34.247025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acb3e0-dc02-4d98-9e98-699d9dce2435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:34.247644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acb3e0-dc02-4d98-9e98-699d9dce2435 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:34.247922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acb3e0-dc02-4d98-9e98-699d9dce2435 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:34.248198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acb3e0-dc02-4d98-9e98-699d9dce2435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:34.248987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acb3e0-dc02-4d98-9e98-699d9dce2435 None admin] RBAC: Adding query filter params (role.id=8785ea09bd024e0ebc5d1b165022df20, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=508186f65cac4ab6b4643d0255725c41) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:34.249318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acb3e0-dc02-4d98-9e98-699d9dce2435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:34.250752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acb3e0-dc02-4d98-9e98-699d9dce2435 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:34.257553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 463/902] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:34 2022] GET /identity/v3/role_assignments?user.id=508186f65cac4ab6b4643d0255725c41&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=8785ea09bd024e0ebc5d1b165022df20 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:34.676123 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d194267-b9f0-4042-b19a-964eb071d0a7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:34.677170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d194267-b9f0-4042-b19a-964eb071d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:34.677170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d194267-b9f0-4042-b19a-964eb071d0a7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:34.678615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 440/903] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:34.684113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428b6d-15f0-433f-828f-1f7b5be830a8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:34.684475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428b6d-15f0-433f-828f-1f7b5be830a8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:34.684720 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428b6d-15f0-433f-828f-1f7b5be830a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:34.704057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f0428b6d-15f0-433f-828f-1f7b5be830a8 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:34.705315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f0428b6d-15f0-433f-828f-1f7b5be830a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:34.707645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdab17-c6db-40be-9f13-bd968b62f2eb None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:34.707962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdab17-c6db-40be-9f13-bd968b62f2eb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:34.708186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdab17-c6db-40be-9f13-bd968b62f2eb None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:34.709601 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 441/904] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:34.715088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11737d47-58db-4a0b-883c-be828786eab3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:34.715429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11737d47-58db-4a0b-883c-be828786eab3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:34.715679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11737d47-58db-4a0b-883c-be828786eab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:34.734306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-11737d47-58db-4a0b-883c-be828786eab3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:34.735511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-11737d47-58db-4a0b-883c-be828786eab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:34.821228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 464/906] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:34.821423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 442/906] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:34.839028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11737d47-58db-4a0b-883c-be828786eab3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:34.861496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428b6d-15f0-433f-828f-1f7b5be830a8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:34.876641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:34.965462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:34.996449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428b6d-15f0-433f-828f-1f7b5be830a8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:35.023315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11737d47-58db-4a0b-883c-be828786eab3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:35.053932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7940df-4898-4419-b2f5-7722e7d57edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:35.054959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7940df-4898-4419-b2f5-7722e7d57edd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:35.055428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7940df-4898-4419-b2f5-7722e7d57edd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:35.055864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7940df-4898-4419-b2f5-7722e7d57edd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:35.056960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7940df-4898-4419-b2f5-7722e7d57edd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:35.059324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7940df-4898-4419-b2f5-7722e7d57edd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7c7940df-4898-4419-b2f5-7722e7d57edd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:35.075206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:35.076205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:45:35.077039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:35.077888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259656f-12dc-4357-bd40-e55dfa14c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:35.077888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259656f-12dc-4357-bd40-e55dfa14c6aa None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:35.077888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259656f-12dc-4357-bd40-e55dfa14c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:35.078107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 465/907] 10.222.0.55 () {56 vars in 1132 bytes} [Mon Jul 25 22:45:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:35.078175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259656f-12dc-4357-bd40-e55dfa14c6aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:35.081145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259656f-12dc-4357-bd40-e55dfa14c6aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:35.085599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259656f-12dc-4357-bd40-e55dfa14c6aa None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:35.090281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7940df-4898-4419-b2f5-7722e7d57edd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-d259656f-12dc-4357-bd40-e55dfa14c6aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:35.101290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:35.103301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:35.104409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 443/908] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:45:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:35.110236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259656f-12dc-4357-bd40-e55dfa14c6aa None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:35.177039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:35.224817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7940df-4898-4419-b2f5-7722e7d57edd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:35.264554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259656f-12dc-4357-bd40-e55dfa14c6aa None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:35.274953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8c566-df5d-4465-b832-6b2ac4b1c391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:35.275753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c566-df5d-4465-b832-6b2ac4b1c391 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:35.276135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c566-df5d-4465-b832-6b2ac4b1c391 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:35.276623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c566-df5d-4465-b832-6b2ac4b1c391 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:35.277777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8c566-df5d-4465-b832-6b2ac4b1c391 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:35.278182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8c566-df5d-4465-b832-6b2ac4b1c391 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:35.279823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8c566-df5d-4465-b832-6b2ac4b1c391 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:35.292157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 466/909] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:35.293223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8c566-df5d-4465-b832-6b2ac4b1c391 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:35.309416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5da0e-5e48-465a-b490-26bdc27185d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:35.310329 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5da0e-5e48-465a-b490-26bdc27185d4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:35.310613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5da0e-5e48-465a-b490-26bdc27185d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:35.310889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5da0e-5e48-465a-b490-26bdc27185d4 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:35.311856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5da0e-5e48-465a-b490-26bdc27185d4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:35.312166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5da0e-5e48-465a-b490-26bdc27185d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:35.314574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5da0e-5e48-465a-b490-26bdc27185d4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:35.318471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:35.329267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 444/910] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:45:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:35.334107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5da0e-5e48-465a-b490-26bdc27185d4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:35.481139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8c566-df5d-4465-b832-6b2ac4b1c391 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:35.494665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5da0e-5e48-465a-b490-26bdc27185d4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:35.520488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c239663-8506-4de7-bde3-b922978b87c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:35.521159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239663-8506-4de7-bde3-b922978b87c0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:35.521457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239663-8506-4de7-bde3-b922978b87c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:35.521762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239663-8506-4de7-bde3-b922978b87c0 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:35.522448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c239663-8506-4de7-bde3-b922978b87c0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:35.522762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c239663-8506-4de7-bde3-b922978b87c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:35.524252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c239663-8506-4de7-bde3-b922978b87c0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:35.526747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:35.535936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 467/911] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:35.535936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404592d-8b61-424c-b49a-c2e06a5b614f None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:35.535936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404592d-8b61-424c-b49a-c2e06a5b614f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:35.535936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404592d-8b61-424c-b49a-c2e06a5b614f None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:35.535936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 468/912] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:35.541757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7aaea-7cce-4e46-8fe8-43598a77701a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:35.542335 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7aaea-7cce-4e46-8fe8-43598a77701a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:35.542728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7aaea-7cce-4e46-8fe8-43598a77701a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:35.549876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965e48a-ca91-44c2-bf8a-7b3f8d26647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:35.551971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965e48a-ca91-44c2-bf8a-7b3f8d26647a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:35.552262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965e48a-ca91-44c2-bf8a-7b3f8d26647a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:35.552546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965e48a-ca91-44c2-bf8a-7b3f8d26647a None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:35.553299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965e48a-ca91-44c2-bf8a-7b3f8d26647a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:35.553614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965e48a-ca91-44c2-bf8a-7b3f8d26647a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:35.555032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965e48a-ca91-44c2-bf8a-7b3f8d26647a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:35.561045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 445/913] 10.222.0.55 () {56 vars in 1114 bytes} [Mon Jul 25 22:45:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:35.561045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965e48a-ca91-44c2-bf8a-7b3f8d26647a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:35.574995 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a8e7aaea-7cce-4e46-8fe8-43598a77701a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:35.577569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a8e7aaea-7cce-4e46-8fe8-43598a77701a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:35.643379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:35.667029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 469/914] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:35.667886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7aaea-7cce-4e46-8fe8-43598a77701a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:35.696993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965e48a-ca91-44c2-bf8a-7b3f8d26647a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:35.764062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99aa8d-5e47-4e0d-a3bf-af500130752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:35.765311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99aa8d-5e47-4e0d-a3bf-af500130752d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:35.765806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99aa8d-5e47-4e0d-a3bf-af500130752d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:35.766291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99aa8d-5e47-4e0d-a3bf-af500130752d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:35.768537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99aa8d-5e47-4e0d-a3bf-af500130752d None admin] RBAC: Adding query filter params (interface=public, service_id=a75908e6e46a4ef08897355192f96fc6, region_id=RegionOne) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:35.769111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99aa8d-5e47-4e0d-a3bf-af500130752d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:35.771770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99aa8d-5e47-4e0d-a3bf-af500130752d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:35.785450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 446/915] 10.222.0.55 () {56 vars in 1251 bytes} [Mon Jul 25 22:45:35 2022] GET /identity/v3/endpoints?service_id=a75908e6e46a4ef08897355192f96fc6&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:35.785450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99aa8d-5e47-4e0d-a3bf-af500130752d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:35.836516 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7aaea-7cce-4e46-8fe8-43598a77701a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:35.891648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:35.903045 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d353cb6-5624-45f5-b27f-67818b575404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:35.904070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d353cb6-5624-45f5-b27f-67818b575404 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:35.904647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d353cb6-5624-45f5-b27f-67818b575404 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:35.905021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d353cb6-5624-45f5-b27f-67818b575404 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:35.906336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d353cb6-5624-45f5-b27f-67818b575404 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:35.911246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d353cb6-5624-45f5-b27f-67818b575404 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:35.945412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99aa8d-5e47-4e0d-a3bf-af500130752d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:36.000732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:36.010983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad937bd-445a-4c16-91ec-4fae2e09da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:36.011757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad937bd-445a-4c16-91ec-4fae2e09da2f None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:36.012123 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad937bd-445a-4c16-91ec-4fae2e09da2f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:36.012458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad937bd-445a-4c16-91ec-4fae2e09da2f None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:36.013323 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad937bd-445a-4c16-91ec-4fae2e09da2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:36.014986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad937bd-445a-4c16-91ec-4fae2e09da2f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:36.036795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 470/916] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 22:45:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:36.038042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d353cb6-5624-45f5-b27f-67818b575404 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:36.117005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 447/917] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:45:35 2022] POST /identity/v3/services => generated 241 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:36.235889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d353cb6-5624-45f5-b27f-67818b575404 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:36.320989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05597b11-04c9-4a98-b0d2-0d9707b4f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:36.322567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05597b11-04c9-4a98-b0d2-0d9707b4f95e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:36.323349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05597b11-04c9-4a98-b0d2-0d9707b4f95e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:36.324077 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05597b11-04c9-4a98-b0d2-0d9707b4f95e None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:36.325621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05597b11-04c9-4a98-b0d2-0d9707b4f95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:36.328415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05597b11-04c9-4a98-b0d2-0d9707b4f95e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:36.342211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 471/918] 10.222.0.55 () {56 vars in 1087 bytes} [Mon Jul 25 22:45:36 2022] GET /identity/v3/services => generated 1497 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:45:37.029506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda902e6-d6d7-48fa-8fbc-badaf9de3664 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:37.030284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda902e6-d6d7-48fa-8fbc-badaf9de3664 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:37.030460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda902e6-d6d7-48fa-8fbc-badaf9de3664 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:37.033377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 448/919] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:37.042482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c897a52-197b-430e-afda-53e075b6bedc None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:37.042943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c897a52-197b-430e-afda-53e075b6bedc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:37.043410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c897a52-197b-430e-afda-53e075b6bedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:37.074977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5c897a52-197b-430e-afda-53e075b6bedc None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:37.076688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5c897a52-197b-430e-afda-53e075b6bedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:37.141504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:37.200543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 472/920] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:37.241923 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda902e6-d6d7-48fa-8fbc-badaf9de3664 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:37.432196 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda902e6-d6d7-48fa-8fbc-badaf9de3664 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:37.490654 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1504-1e55-4d40-8f34-3f9d05ca2c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:37.491611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1504-1e55-4d40-8f34-3f9d05ca2c94 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:37.492030 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1504-1e55-4d40-8f34-3f9d05ca2c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:37.492442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1504-1e55-4d40-8f34-3f9d05ca2c94 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:37.509956 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c1504-1e55-4d40-8f34-3f9d05ca2c94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-818c1504-1e55-4d40-8f34-3f9d05ca2c94 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:37.518795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:37.520539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:37.522387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 449/921] 10.222.0.55 () {56 vars in 1120 bytes} [Mon Jul 25 22:45:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:37.530510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c897a52-197b-430e-afda-53e075b6bedc None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:37.707567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c897a52-197b-430e-afda-53e075b6bedc None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:37.771397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbceb1-00dc-44ea-95a6-382ab24acc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:37.772740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbceb1-00dc-44ea-95a6-382ab24acc83 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:37.773501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbceb1-00dc-44ea-95a6-382ab24acc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:37.774161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbceb1-00dc-44ea-95a6-382ab24acc83 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:37.775520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbceb1-00dc-44ea-95a6-382ab24acc83 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:37.776228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbceb1-00dc-44ea-95a6-382ab24acc83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:37.778839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbceb1-00dc-44ea-95a6-382ab24acc83 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:37.794368 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 473/922] 10.222.0.55 () {56 vars in 1115 bytes} [Mon Jul 25 22:45:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:37.802473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1504-1e55-4d40-8f34-3f9d05ca2c94 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:37.906524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:38.005000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1504-1e55-4d40-8f34-3f9d05ca2c94 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:38.107550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789e5ae-b40d-4d09-8173-45372c659bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:38.108959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789e5ae-b40d-4d09-8173-45372c659bea None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:38.109468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789e5ae-b40d-4d09-8173-45372c659bea None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:38.109949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789e5ae-b40d-4d09-8173-45372c659bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:38.126185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789e5ae-b40d-4d09-8173-45372c659bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:38.133390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789e5ae-b40d-4d09-8173-45372c659bea None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b789e5ae-b40d-4d09-8173-45372c659bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:38.165522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:38.166551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:38.167433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:38.167433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:38.167433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:38.167433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:38.172116 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 450/923] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:38.180059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbceb1-00dc-44ea-95a6-382ab24acc83 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:38.232272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:38.327241 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbceb1-00dc-44ea-95a6-382ab24acc83 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:38.369037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149df94-11fe-4c07-a491-1d753ec890d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:38.370197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149df94-11fe-4c07-a491-1d753ec890d0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:38.370632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149df94-11fe-4c07-a491-1d753ec890d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:38.371061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149df94-11fe-4c07-a491-1d753ec890d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:38.371918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149df94-11fe-4c07-a491-1d753ec890d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:38.372384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149df94-11fe-4c07-a491-1d753ec890d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:38.373957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149df94-11fe-4c07-a491-1d753ec890d0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:38.389356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 474/924] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:38.402366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789e5ae-b40d-4d09-8173-45372c659bea None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:38.547595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:38.551469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789e5ae-b40d-4d09-8173-45372c659bea None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:38.593000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dda39-0a17-43ad-b69a-2cee60ddf848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:38.593949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dda39-0a17-43ad-b69a-2cee60ddf848 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:38.594392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dda39-0a17-43ad-b69a-2cee60ddf848 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:38.594820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dda39-0a17-43ad-b69a-2cee60ddf848 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:38.604316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dda39-0a17-43ad-b69a-2cee60ddf848 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:38.606180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dda39-0a17-43ad-b69a-2cee60ddf848 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-6f9dda39-0a17-43ad-b69a-2cee60ddf848 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:38.619267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:38.620421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:38.621520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:38.621520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:38.621520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:38.621520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:38.621520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:38.621520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:38.621520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:38.621520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:38.621520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:38.621520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:38.623842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 451/925] 10.222.0.55 () {56 vars in 1117 bytes} [Mon Jul 25 22:45:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:38.633770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149df94-11fe-4c07-a491-1d753ec890d0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:38.807762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:38.816452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149df94-11fe-4c07-a491-1d753ec890d0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:38.868021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36f95a-9253-48ef-aa65-5f77a676ffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:38.869502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36f95a-9253-48ef-aa65-5f77a676ffc2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:38.870241 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36f95a-9253-48ef-aa65-5f77a676ffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:38.870973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36f95a-9253-48ef-aa65-5f77a676ffc2 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:38.872777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36f95a-9253-48ef-aa65-5f77a676ffc2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:38.873652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36f95a-9253-48ef-aa65-5f77a676ffc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:38.876649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36f95a-9253-48ef-aa65-5f77a676ffc2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:38.914822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 475/926] 10.222.0.55 () {56 vars in 1149 bytes} [Mon Jul 25 22:45:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:38.922605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dda39-0a17-43ad-b69a-2cee60ddf848 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:39.073638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dda39-0a17-43ad-b69a-2cee60ddf848 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:39.117336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903de02b-b45a-4e26-b66c-317763e31cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:39.118321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903de02b-b45a-4e26-b66c-317763e31cde None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.118321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903de02b-b45a-4e26-b66c-317763e31cde None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.118610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903de02b-b45a-4e26-b66c-317763e31cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.132798 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903de02b-b45a-4e26-b66c-317763e31cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:39.134321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903de02b-b45a-4e26-b66c-317763e31cde None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-903de02b-b45a-4e26-b66c-317763e31cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:39.151466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:39.153363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:39.155207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:39.155207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:39.155207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:39.155207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:39.155207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 452/927] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:39.159250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36f95a-9253-48ef-aa65-5f77a676ffc2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:39.187846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb207ea-c3f7-4de6-84b5-d97c27df11f5 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.188253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb207ea-c3f7-4de6-84b5-d97c27df11f5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.188521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb207ea-c3f7-4de6-84b5-d97c27df11f5 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.190607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 453/928] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:39.197736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09468518-a354-4e75-b585-51b05146ddd2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.198364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09468518-a354-4e75-b585-51b05146ddd2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.199262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09468518-a354-4e75-b585-51b05146ddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.226785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-09468518-a354-4e75-b585-51b05146ddd2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:39.229360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-09468518-a354-4e75-b585-51b05146ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:39.246764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:39.303681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36f95a-9253-48ef-aa65-5f77a676ffc2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:39.350095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 454/929] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:39.351643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f6a26-2648-482f-8c69-520c687f2222 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.352067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f6a26-2648-482f-8c69-520c687f2222 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.352471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f6a26-2648-482f-8c69-520c687f2222 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.354169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 455/930] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:39.361057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4426fd-74ea-4b99-9520-75dc01e5700f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.362681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4426fd-74ea-4b99-9520-75dc01e5700f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.363296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4426fd-74ea-4b99-9520-75dc01e5700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.378662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82428ed8-16e8-4883-b93e-b9212a46df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:39.379485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82428ed8-16e8-4883-b93e-b9212a46df26 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.380194 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82428ed8-16e8-4883-b93e-b9212a46df26 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.381032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82428ed8-16e8-4883-b93e-b9212a46df26 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.382344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82428ed8-16e8-4883-b93e-b9212a46df26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:39.382890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82428ed8-16e8-4883-b93e-b9212a46df26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:39.385500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82428ed8-16e8-4883-b93e-b9212a46df26 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:39.397925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ad4426fd-74ea-4b99-9520-75dc01e5700f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:39.400586 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ad4426fd-74ea-4b99-9520-75dc01e5700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:39.408197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 476/931] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:39.410326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82428ed8-16e8-4883-b93e-b9212a46df26 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:39.431723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:39.524043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 456/932] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:39.525591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4426fd-74ea-4b99-9520-75dc01e5700f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:39.575598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82428ed8-16e8-4883-b93e-b9212a46df26 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:39.614406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122129b4-b4fa-4d15-89be-29cb0d301e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:39.615088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122129b4-b4fa-4d15-89be-29cb0d301e9a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.615359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122129b4-b4fa-4d15-89be-29cb0d301e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.615632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122129b4-b4fa-4d15-89be-29cb0d301e9a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.616284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122129b4-b4fa-4d15-89be-29cb0d301e9a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:39.617779 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122129b4-b4fa-4d15-89be-29cb0d301e9a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-122129b4-b4fa-4d15-89be-29cb0d301e9a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:39.627645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:39.637982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:39.640420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 477/933] 10.222.0.55 () {56 vars in 1132 bytes} [Mon Jul 25 22:45:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:39.641544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122129b4-b4fa-4d15-89be-29cb0d301e9a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:39.641623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:39.684599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4426fd-74ea-4b99-9520-75dc01e5700f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:39.734658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981e3eb-d8e2-4ad2-a938-38b7e7b7f015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:39.735436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e3eb-d8e2-4ad2-a938-38b7e7b7f015 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.735897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e3eb-d8e2-4ad2-a938-38b7e7b7f015 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.736320 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e3eb-d8e2-4ad2-a938-38b7e7b7f015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.739012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:39.746252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981e3eb-d8e2-4ad2-a938-38b7e7b7f015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:39.751590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981e3eb-d8e2-4ad2-a938-38b7e7b7f015 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-5981e3eb-d8e2-4ad2-a938-38b7e7b7f015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:39.762392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:39.763906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 457/934] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f701755-275d-4f66-81ac-d1e7391e3ba5 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.772811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f701755-275d-4f66-81ac-d1e7391e3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.773782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f701755-275d-4f66-81ac-d1e7391e3ba5 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.773782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 458/935] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:39.773916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122129b4-b4fa-4d15-89be-29cb0d301e9a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:39.773991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f701755-275d-4f66-81ac-d1e7391e3ba5 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:39.820598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:39.821439 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.821823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.822182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.822971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:39.824618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:39.827555 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WARNING keystone.server.flask.common [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 22:45:39.895923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.sql.core [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:45:39.895923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 22:45:39.895923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [parameters: {'id': '3e45761ea94d4477b53788f6a867bd99', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 22:45:39.895923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80370) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:45:39.900002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f701755-275d-4f66-81ac-d1e7391e3ba5 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e45761ea94d4477b53788f6a867bd99.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e45761ea94d4477b53788f6a867bd99. Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:45:39.914457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result.read() Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 22:45:39.924012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application yield resource Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise self.value Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application session.commit() Jul 25 22:45:39.926916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:45:39.928453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:45:39.929916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result.read() Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:45:39.931617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [parameters: {'id': '3e45761ea94d4477b53788f6a867bd99', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:39.932711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:39.934004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e45761ea94d4477b53788f6a867bd99. Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 478/936] 10.222.0.55 () {60 vars in 1140 bytes} [Mon Jul 25 22:45:39 2022] POST /identity/v3/projects => generated 262 bytes in 286 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:39.935308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:39.947053 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:39.952373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c01b56-8836-47e2-bd67-fffad50030e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:39.953030 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01b56-8836-47e2-bd67-fffad50030e1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.953326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01b56-8836-47e2-bd67-fffad50030e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.953608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01b56-8836-47e2-bd67-fffad50030e1 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.954412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c01b56-8836-47e2-bd67-fffad50030e1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:39.954713 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c01b56-8836-47e2-bd67-fffad50030e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:39.956205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c01b56-8836-47e2-bd67-fffad50030e1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:39.961443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 459/937] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:39.962682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08369-e879-496e-8b97-4673846f8e3e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:39.963058 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08369-e879-496e-8b97-4673846f8e3e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:39.963353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08369-e879-496e-8b97-4673846f8e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:39.982053 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ffc08369-e879-496e-8b97-4673846f8e3e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:39.991209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ffc08369-e879-496e-8b97-4673846f8e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:40.067561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 460/938] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:40.068731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc08369-e879-496e-8b97-4673846f8e3e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:40.099036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25b430-4547-4662-ae12-185148cc1f1a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:40.137064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:40.144392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae76c0-f502-477d-bd60-9ef32afac9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:40.145103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae76c0-f502-477d-bd60-9ef32afac9bd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:40.145544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae76c0-f502-477d-bd60-9ef32afac9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:40.146004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae76c0-f502-477d-bd60-9ef32afac9bd None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:40.146923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae76c0-f502-477d-bd60-9ef32afac9bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:40.147512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae76c0-f502-477d-bd60-9ef32afac9bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:40.149269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae76c0-f502-477d-bd60-9ef32afac9bd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:40.167837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 479/939] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:40.169284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae76c0-f502-477d-bd60-9ef32afac9bd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:40.202609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc08369-e879-496e-8b97-4673846f8e3e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:40.242577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:40.253469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7572cb-345c-48a5-a783-d13a913f3d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:40.254349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7572cb-345c-48a5-a783-d13a913f3d14 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:40.254716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7572cb-345c-48a5-a783-d13a913f3d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:40.255075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7572cb-345c-48a5-a783-d13a913f3d14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:40.263022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7572cb-345c-48a5-a783-d13a913f3d14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:40.264629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7572cb-345c-48a5-a783-d13a913f3d14 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7e7572cb-345c-48a5-a783-d13a913f3d14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:40.277948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:40.279645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:40.281503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:40.281503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:40.281503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:40.281503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:40.281503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:40.281503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:40.281503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:40.281503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:40.285482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 461/940] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:40.286897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7572cb-345c-48a5-a783-d13a913f3d14 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:40.287706 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae76c0-f502-477d-bd60-9ef32afac9bd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:40.334205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640264c-e112-4d8a-9807-ac771f85790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:40.334475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640264c-e112-4d8a-9807-ac771f85790e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:40.334770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640264c-e112-4d8a-9807-ac771f85790e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:40.335260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640264c-e112-4d8a-9807-ac771f85790e None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:40.336546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640264c-e112-4d8a-9807-ac771f85790e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:40.337098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640264c-e112-4d8a-9807-ac771f85790e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:40.339765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640264c-e112-4d8a-9807-ac771f85790e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:40.346565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 480/941] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:40.347695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640264c-e112-4d8a-9807-ac771f85790e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:40.410229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:40.445768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7572cb-345c-48a5-a783-d13a913f3d14 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:40.462372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640264c-e112-4d8a-9807-ac771f85790e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:40.488975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272e3f0-f2da-4bb4-bdb7-01e2c87c517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:40.490032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272e3f0-f2da-4bb4-bdb7-01e2c87c517d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:40.490446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272e3f0-f2da-4bb4-bdb7-01e2c87c517d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:40.490845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272e3f0-f2da-4bb4-bdb7-01e2c87c517d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:40.491624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272e3f0-f2da-4bb4-bdb7-01e2c87c517d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:40.493226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272e3f0-f2da-4bb4-bdb7-01e2c87c517d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-9272e3f0-f2da-4bb4-bdb7-01e2c87c517d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:40.504394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:40.506414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:40.508157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 462/942] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:40.509728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272e3f0-f2da-4bb4-bdb7-01e2c87c517d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:40.516894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbbcf3-b163-4939-9e86-6a9de89a6c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:40.517719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbbcf3-b163-4939-9e86-6a9de89a6c21 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:40.518568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbbcf3-b163-4939-9e86-6a9de89a6c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:40.518900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbbcf3-b163-4939-9e86-6a9de89a6c21 None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/508186f65cac4ab6b4643d0255725c41/roles/8785ea09bd024e0ebc5d1b165022df20` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:40.521679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbbcf3-b163-4939-9e86-6a9de89a6c21 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=508186f65cac4ab6b4643d0255725c41, role_id=8785ea09bd024e0ebc5d1b165022df20)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:40.523290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbbcf3-b163-4939-9e86-6a9de89a6c21 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:40.591955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:40.630503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 481/943] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:45:40 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/508186f65cac4ab6b4643d0255725c41/roles/8785ea09bd024e0ebc5d1b165022df20 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:45:40.631620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbbcf3-b163-4939-9e86-6a9de89a6c21 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:40.686904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272e3f0-f2da-4bb4-bdb7-01e2c87c517d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:40.736066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4fbc8-64de-45a2-885b-0fe36385a205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:40.736778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4fbc8-64de-45a2-885b-0fe36385a205 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:40.737871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4fbc8-64de-45a2-885b-0fe36385a205 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:40.737871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4fbc8-64de-45a2-885b-0fe36385a205 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:40.738323 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4fbc8-64de-45a2-885b-0fe36385a205 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:40.738644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4fbc8-64de-45a2-885b-0fe36385a205 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:40.740162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4fbc8-64de-45a2-885b-0fe36385a205 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:40.769457 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 463/944] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:40.769457 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4fbc8-64de-45a2-885b-0fe36385a205 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:40.841918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbbcf3-b163-4939-9e86-6a9de89a6c21 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:40.881932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:40.917079 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a296c8-a890-46d2-8fbe-dedb0840e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:40.918187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a296c8-a890-46d2-8fbe-dedb0840e760 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:40.918647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a296c8-a890-46d2-8fbe-dedb0840e760 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:40.919593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a296c8-a890-46d2-8fbe-dedb0840e760 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:40.922070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a296c8-a890-46d2-8fbe-dedb0840e760 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:40.925249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a296c8-a890-46d2-8fbe-dedb0840e760 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:40.972462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4fbc8-64de-45a2-885b-0fe36385a205 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:40.989194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:41.022804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a794-19c8-41c2-a369-ce226fd987e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:41.023455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a794-19c8-41c2-a369-ce226fd987e4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:41.023738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a794-19c8-41c2-a369-ce226fd987e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:41.024182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a794-19c8-41c2-a369-ce226fd987e4 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:41.024926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9a794-19c8-41c2-a369-ce226fd987e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:41.025327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9a794-19c8-41c2-a369-ce226fd987e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:41.026827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9a794-19c8-41c2-a369-ce226fd987e4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:41.030865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 482/945] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 22:45:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:41.034545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 464/946] 10.222.0.55 () {56 vars in 1122 bytes} [Mon Jul 25 22:45:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:41.042150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a296c8-a890-46d2-8fbe-dedb0840e760 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:41.211604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a296c8-a890-46d2-8fbe-dedb0840e760 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:41.272788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a9de-6275-4bba-8d2f-3a9db7ac97ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:41.273859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a9de-6275-4bba-8d2f-3a9db7ac97ff None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:41.274357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a9de-6275-4bba-8d2f-3a9db7ac97ff None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:41.274912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a9de-6275-4bba-8d2f-3a9db7ac97ff None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:41.276261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624a9de-6275-4bba-8d2f-3a9db7ac97ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:41.276811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624a9de-6275-4bba-8d2f-3a9db7ac97ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:41.279548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624a9de-6275-4bba-8d2f-3a9db7ac97ff None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:41.291758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 483/947] 10.222.0.55 () {56 vars in 1122 bytes} [Mon Jul 25 22:45:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:41.298413 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a794-19c8-41c2-a369-ce226fd987e4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:41.462765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a794-19c8-41c2-a369-ce226fd987e4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:41.504117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee46331-28e1-4b0a-a6ab-b6592044cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:41.504769 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46331-28e1-4b0a-a6ab-b6592044cb4d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:41.505049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46331-28e1-4b0a-a6ab-b6592044cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:41.505355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46331-28e1-4b0a-a6ab-b6592044cb4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:41.506222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee46331-28e1-4b0a-a6ab-b6592044cb4d None admin] RBAC: Adding query filter params (interface=public, service_id=90e67507c2f2482a970b5e62dc553434, region_id=RegionOne) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:41.506537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee46331-28e1-4b0a-a6ab-b6592044cb4d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:41.507966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee46331-28e1-4b0a-a6ab-b6592044cb4d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:41.514440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 465/948] 10.222.0.55 () {56 vars in 1251 bytes} [Mon Jul 25 22:45:41 2022] GET /identity/v3/endpoints?service_id=90e67507c2f2482a970b5e62dc553434&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:41.525447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a9de-6275-4bba-8d2f-3a9db7ac97ff None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:41.588774 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:41.678866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a9de-6275-4bba-8d2f-3a9db7ac97ff None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:41.724329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929217d-4dcd-4e21-9ea2-c12fe5720339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:41.724996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929217d-4dcd-4e21-9ea2-c12fe5720339 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:41.725312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929217d-4dcd-4e21-9ea2-c12fe5720339 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:41.725594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929217d-4dcd-4e21-9ea2-c12fe5720339 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:41.726381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929217d-4dcd-4e21-9ea2-c12fe5720339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:41.728002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929217d-4dcd-4e21-9ea2-c12fe5720339 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:41.736219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 484/949] 10.222.0.55 () {56 vars in 1087 bytes} [Mon Jul 25 22:45:41 2022] GET /identity/v3/services => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:45:43.138360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3822a-bf98-4532-a8c5-53d9d02dcb00 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:43.139297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3822a-bf98-4532-a8c5-53d9d02dcb00 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:43.139297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3822a-bf98-4532-a8c5-53d9d02dcb00 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:43.140540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 466/950] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:43.150936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de4a90-fb5f-450d-b626-1788536b373b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:43.152594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de4a90-fb5f-450d-b626-1788536b373b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:43.153582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de4a90-fb5f-450d-b626-1788536b373b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:43.193071 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f5de4a90-fb5f-450d-b626-1788536b373b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:43.196014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f5de4a90-fb5f-450d-b626-1788536b373b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:43.334583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 485/951] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:43.364183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3822a-bf98-4532-a8c5-53d9d02dcb00 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:43.430131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:43.434530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4cbd1-7ce8-4ab5-931a-069712b301b2 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:43.435037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4cbd1-7ce8-4ab5-931a-069712b301b2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:43.435525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4cbd1-7ce8-4ab5-931a-069712b301b2 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:43.438497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 486/952] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:43.447976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de8a1-e84f-4b07-ba41-9bed2b47e439 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:43.448470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de8a1-e84f-4b07-ba41-9bed2b47e439 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:43.448987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de8a1-e84f-4b07-ba41-9bed2b47e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:43.487413 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-845de8a1-e84f-4b07-ba41-9bed2b47e439 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:43.490097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-845de8a1-e84f-4b07-ba41-9bed2b47e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:43.520273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3822a-bf98-4532-a8c5-53d9d02dcb00 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:43.530792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:43.603771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 487/953] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:43.614254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e702e-7b42-4654-981e-e8f7cdc23f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:43.617244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e702e-7b42-4654-981e-e8f7cdc23f22 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:43.617244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e702e-7b42-4654-981e-e8f7cdc23f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:43.617244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e702e-7b42-4654-981e-e8f7cdc23f22 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:43.635089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de8a1-e84f-4b07-ba41-9bed2b47e439 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:43.645676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e702e-7b42-4654-981e-e8f7cdc23f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f19e702e-7b42-4654-981e-e8f7cdc23f22 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:43.649367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:43.650397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:45:43.651340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:43.654356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 467/954] 10.222.0.55 () {56 vars in 1120 bytes} [Mon Jul 25 22:45:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:43.665309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e702e-7b42-4654-981e-e8f7cdc23f22 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:43.779397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de8a1-e84f-4b07-ba41-9bed2b47e439 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:43.810725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:43.818630 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e702e-7b42-4654-981e-e8f7cdc23f22 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:43.826170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d5b97-5ef7-4550-bd51-d4c5a7a24abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:43.827224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5b97-5ef7-4550-bd51-d4c5a7a24abf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:43.827708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5b97-5ef7-4550-bd51-d4c5a7a24abf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:43.828191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5b97-5ef7-4550-bd51-d4c5a7a24abf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:43.829030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d5b97-5ef7-4550-bd51-d4c5a7a24abf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:43.831349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d5b97-5ef7-4550-bd51-d4c5a7a24abf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-501d5b97-5ef7-4550-bd51-d4c5a7a24abf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:43.841362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:43.842532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:45:43.843374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:43.853414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 488/955] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:43.855202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c8f7c-257b-4d40-a7d1-4f2556a69585 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:43.855711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c8f7c-257b-4d40-a7d1-4f2556a69585 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:43.856184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c8f7c-257b-4d40-a7d1-4f2556a69585 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:43.857838 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 489/956] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:43.858827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c8f7c-257b-4d40-a7d1-4f2556a69585 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:43.881059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab65199-dfca-441d-8474-ac9f417b25e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:43.881892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65199-dfca-441d-8474-ac9f417b25e4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:43.882174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65199-dfca-441d-8474-ac9f417b25e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:43.882554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65199-dfca-441d-8474-ac9f417b25e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:43.883166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab65199-dfca-441d-8474-ac9f417b25e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:43.883469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab65199-dfca-441d-8474-ac9f417b25e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:43.885180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab65199-dfca-441d-8474-ac9f417b25e4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:43.894400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:43.903815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 468/957] 10.222.0.55 () {56 vars in 1115 bytes} [Mon Jul 25 22:45:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:43.903815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfacad-0120-48ab-b7da-4e1ce1e2bae2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:43.903815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfacad-0120-48ab-b7da-4e1ce1e2bae2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:43.903815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfacad-0120-48ab-b7da-4e1ce1e2bae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:43.931015 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4edfacad-0120-48ab-b7da-4e1ce1e2bae2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:43.933055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4edfacad-0120-48ab-b7da-4e1ce1e2bae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:44.013081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c8f7c-257b-4d40-a7d1-4f2556a69585 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:44.054865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 469/958] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:44.057448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f22cd2-c224-49eb-b20e-410079538d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:44.058097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f22cd2-c224-49eb-b20e-410079538d62 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.058384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f22cd2-c224-49eb-b20e-410079538d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.058665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f22cd2-c224-49eb-b20e-410079538d62 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.059371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f22cd2-c224-49eb-b20e-410079538d62 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:44.059678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f22cd2-c224-49eb-b20e-410079538d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:44.061078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f22cd2-c224-49eb-b20e-410079538d62 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:44.066154 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfacad-0120-48ab-b7da-4e1ce1e2bae2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:44.073168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 490/959] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:44.076317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f22cd2-c224-49eb-b20e-410079538d62 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:44.210050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:44.210958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:44.227050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfacad-0120-48ab-b7da-4e1ce1e2bae2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:44.232141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f22cd2-c224-49eb-b20e-410079538d62 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:44.291190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af4ff-bf47-4a76-8945-275f53dac856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:44.292191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af4ff-bf47-4a76-8945-275f53dac856 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.292762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af4ff-bf47-4a76-8945-275f53dac856 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.293261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af4ff-bf47-4a76-8945-275f53dac856 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.293450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61409da9-60b0-491d-82f2-e57e5ed12caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:44.294425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61409da9-60b0-491d-82f2-e57e5ed12caa None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.294611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0af4ff-bf47-4a76-8945-275f53dac856 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:44.294881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61409da9-60b0-491d-82f2-e57e5ed12caa None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.295105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0af4ff-bf47-4a76-8945-275f53dac856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:44.295319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61409da9-60b0-491d-82f2-e57e5ed12caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.297678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0af4ff-bf47-4a76-8945-275f53dac856 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:44.313331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 491/960] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:44.313331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af4ff-bf47-4a76-8945-275f53dac856 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:44.318101 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61409da9-60b0-491d-82f2-e57e5ed12caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:44.319861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61409da9-60b0-491d-82f2-e57e5ed12caa None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-61409da9-60b0-491d-82f2-e57e5ed12caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:44.347111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:44.348919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:44.351446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:44.351446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:44.351446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:44.351446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:44.351446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 470/961] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:44.351446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e9cf8-a6fb-4e5d-81cb-066dfdcbe1a7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.351446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e9cf8-a6fb-4e5d-81cb-066dfdcbe1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.351446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e9cf8-a6fb-4e5d-81cb-066dfdcbe1a7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.353325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 471/962] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:44.355625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e9cf8-a6fb-4e5d-81cb-066dfdcbe1a7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:44.463573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af4ff-bf47-4a76-8945-275f53dac856 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:44.504346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171cd2-9135-4660-af1c-2be5619871cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:44.504984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171cd2-9135-4660-af1c-2be5619871cc None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.505317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171cd2-9135-4660-af1c-2be5619871cc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.505573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171cd2-9135-4660-af1c-2be5619871cc None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.506262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9171cd2-9135-4660-af1c-2be5619871cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:44.507726 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9171cd2-9135-4660-af1c-2be5619871cc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:44.509736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e9cf8-a6fb-4e5d-81cb-066dfdcbe1a7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:44.554816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ec58f-5729-4cce-988f-3ac7830f72d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:44.555448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ec58f-5729-4cce-988f-3ac7830f72d7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.555731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ec58f-5729-4cce-988f-3ac7830f72d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.556009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ec58f-5729-4cce-988f-3ac7830f72d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.556712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ec58f-5729-4cce-988f-3ac7830f72d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:44.557020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ec58f-5729-4cce-988f-3ac7830f72d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:44.558454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ec58f-5729-4cce-988f-3ac7830f72d7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:44.572483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 472/963] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:44.573699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f998acf-a23c-4ee5-83e7-a168f67d0a61 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.573992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f998acf-a23c-4ee5-83e7-a168f67d0a61 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.574341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f998acf-a23c-4ee5-83e7-a168f67d0a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.578762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.sql.core [None req-f9171cd2-9135-4660-af1c-2be5619871cc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:45:44.578762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 22:45:44.578762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [parameters: {'user_id': '2d169edad5dd46299a2898e70fbf72db', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 22:45:44.578762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80370) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:45:44.583348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f9171cd2-9135-4660-af1c-2be5619871cc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result.read() Jul 25 22:45:44.590294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:45:44.591476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application yield resource Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise self.value Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application session.commit() Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:45:44.592424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:45:44.593419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:45:44.594448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result.read() Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:45:44.595513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [parameters: {'user_id': '2d169edad5dd46299a2898e70fbf72db', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:44.596372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 22:45:44.597340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 22:45:44.598283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 22:45:44.598283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 22:45:44.598283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:45:44.598283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:45:44.598283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 22:45:44.598283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:44.598283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 492/964] 10.222.0.55 () {60 vars in 1131 bytes} [Mon Jul 25 22:45:44 2022] POST /identity/v3/users => generated 160 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:44.598283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171cd2-9135-4660-af1c-2be5619871cc None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:44.605341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0f998acf-a23c-4ee5-83e7-a168f67d0a61 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:44.606575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0f998acf-a23c-4ee5-83e7-a168f67d0a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:44.614585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:44.689710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 473/965] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:44.697170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f998acf-a23c-4ee5-83e7-a168f67d0a61 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:44.724169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171cd2-9135-4660-af1c-2be5619871cc None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:44.768426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfdcf8-13d2-4b14-854e-63c282aaa301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:44.769371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfdcf8-13d2-4b14-854e-63c282aaa301 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.769824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfdcf8-13d2-4b14-854e-63c282aaa301 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.770243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfdcf8-13d2-4b14-854e-63c282aaa301 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.784702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfdcf8-13d2-4b14-854e-63c282aaa301 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:44.787970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfdcf8-13d2-4b14-854e-63c282aaa301 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-1bbfdcf8-13d2-4b14-854e-63c282aaa301 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:44.811914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:44.813101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:44.814234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:44.814234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:44.814234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:44.814234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:44.814234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:44.814234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:44.814234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:44.814234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:44.814234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:45:44.814234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:44.821743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 493/966] 10.222.0.55 () {56 vars in 1117 bytes} [Mon Jul 25 22:45:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:44.821743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfdcf8-13d2-4b14-854e-63c282aaa301 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:44.855176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f998acf-a23c-4ee5-83e7-a168f67d0a61 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:44.891288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:44.898447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc02e-f81b-42ef-b595-c1ca402bdd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:44.899570 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc02e-f81b-42ef-b595-c1ca402bdd0c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.899850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc02e-f81b-42ef-b595-c1ca402bdd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.900296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc02e-f81b-42ef-b595-c1ca402bdd0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.909371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc02e-f81b-42ef-b595-c1ca402bdd0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:44.911290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc02e-f81b-42ef-b595-c1ca402bdd0c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:44.919328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-a14fc02e-f81b-42ef-b595-c1ca402bdd0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:44.923546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:44.924915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:44.927272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:44.927272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:44.927272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:44.927272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:44.927272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:44.927272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:44.927272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:44.927272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:44.927272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:45:44.927272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:44.930310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 474/967] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:45:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:44.931660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc02e-f81b-42ef-b595-c1ca402bdd0c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:44.972525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfdcf8-13d2-4b14-854e-63c282aaa301 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:45.038822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a119bd9-fec5-48aa-be72-b29ae664152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:45.039485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a119bd9-fec5-48aa-be72-b29ae664152f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:45.039910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a119bd9-fec5-48aa-be72-b29ae664152f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:45.040149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a119bd9-fec5-48aa-be72-b29ae664152f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:45.040902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a119bd9-fec5-48aa-be72-b29ae664152f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:45.042398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a119bd9-fec5-48aa-be72-b29ae664152f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-8a119bd9-fec5-48aa-be72-b29ae664152f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:45.053178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:45.054831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:45.056301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 494/968] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:45.057391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a119bd9-fec5-48aa-be72-b29ae664152f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:45.071216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc02e-f81b-42ef-b595-c1ca402bdd0c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:45.129599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da467e28-2469-4ac4-966d-9dcd47f111a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:45.130360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da467e28-2469-4ac4-966d-9dcd47f111a3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:45.130858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da467e28-2469-4ac4-966d-9dcd47f111a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:45.131254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da467e28-2469-4ac4-966d-9dcd47f111a3 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:45.132371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da467e28-2469-4ac4-966d-9dcd47f111a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:45.132844 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da467e28-2469-4ac4-966d-9dcd47f111a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:45.136810 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da467e28-2469-4ac4-966d-9dcd47f111a3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:45.179806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 475/969] 10.222.0.55 () {56 vars in 1149 bytes} [Mon Jul 25 22:45:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:45.181779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da467e28-2469-4ac4-966d-9dcd47f111a3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:45.207502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a119bd9-fec5-48aa-be72-b29ae664152f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:45.240336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:45.246979 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c093162-9681-43e5-a0fd-501baeb72d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:45.247525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093162-9681-43e5-a0fd-501baeb72d7c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:45.247723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093162-9681-43e5-a0fd-501baeb72d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:45.248006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093162-9681-43e5-a0fd-501baeb72d7c None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:45.248798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c093162-9681-43e5-a0fd-501baeb72d7c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:45.253876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c093162-9681-43e5-a0fd-501baeb72d7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:45.253876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c093162-9681-43e5-a0fd-501baeb72d7c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:45.253876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:45.293499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 495/970] 10.222.0.55 () {56 vars in 1101 bytes} [Mon Jul 25 22:45:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:45.294534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c093162-9681-43e5-a0fd-501baeb72d7c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:45.303995 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da467e28-2469-4ac4-966d-9dcd47f111a3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:45.353444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30b73e-25b7-4497-b80e-7016825c27cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:45.354088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30b73e-25b7-4497-b80e-7016825c27cf None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:45.354911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30b73e-25b7-4497-b80e-7016825c27cf None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:45.355201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30b73e-25b7-4497-b80e-7016825c27cf None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:45.355918 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30b73e-25b7-4497-b80e-7016825c27cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:45.356245 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30b73e-25b7-4497-b80e-7016825c27cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:45.358099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30b73e-25b7-4497-b80e-7016825c27cf None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:45.369315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 476/971] 10.222.0.55 () {56 vars in 1122 bytes} [Mon Jul 25 22:45:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:45.373916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30b73e-25b7-4497-b80e-7016825c27cf None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:45.440867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c093162-9681-43e5-a0fd-501baeb72d7c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:45.489431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff3ee5-0796-4e50-8a1d-45cbe4af9c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:45.490405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff3ee5-0796-4e50-8a1d-45cbe4af9c30 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:45.490872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff3ee5-0796-4e50-8a1d-45cbe4af9c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:45.491353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff3ee5-0796-4e50-8a1d-45cbe4af9c30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:45.535346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30b73e-25b7-4497-b80e-7016825c27cf None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:45.554060 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:45.572218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:45.581374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526f5a-d859-4d67-bacc-4dd8e590a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:45.582111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526f5a-d859-4d67-bacc-4dd8e590a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:45.582391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526f5a-d859-4d67-bacc-4dd8e590a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:45.582668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526f5a-d859-4d67-bacc-4dd8e590a2c8 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:45.583432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526f5a-d859-4d67-bacc-4dd8e590a2c8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:45.583738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526f5a-d859-4d67-bacc-4dd8e590a2c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:45.585160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526f5a-d859-4d67-bacc-4dd8e590a2c8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:45.585342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff3ee5-0796-4e50-8a1d-45cbe4af9c30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:45.586769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff3ee5-0796-4e50-8a1d-45cbe4af9c30 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:45.592865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 477/972] 10.222.0.55 () {56 vars in 1122 bytes} [Mon Jul 25 22:45:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:45.599804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526f5a-d859-4d67-bacc-4dd8e590a2c8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:45.727766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526f5a-d859-4d67-bacc-4dd8e590a2c8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:45.730880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 496/973] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:45 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:45:45.736221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff3ee5-0796-4e50-8a1d-45cbe4af9c30 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:45.775166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc2cbd-4a73-4b28-8c6a-a2baa154324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:45.775857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc2cbd-4a73-4b28-8c6a-a2baa154324a None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:45.776145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc2cbd-4a73-4b28-8c6a-a2baa154324a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:45.776421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc2cbd-4a73-4b28-8c6a-a2baa154324a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:45.777174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc2cbd-4a73-4b28-8c6a-a2baa154324a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:45.778603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc2cbd-4a73-4b28-8c6a-a2baa154324a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:45.839403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:45.853513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff3ee5-0796-4e50-8a1d-45cbe4af9c30 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:45.894132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 478/974] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 22:45:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:45.914471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e51d6-8d31-4abd-b806-452655ede0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:45.915140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e51d6-8d31-4abd-b806-452655ede0ef None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:45.915419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e51d6-8d31-4abd-b806-452655ede0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:45.915691 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e51d6-8d31-4abd-b806-452655ede0ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:45.928931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e51d6-8d31-4abd-b806-452655ede0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:45.930465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e51d6-8d31-4abd-b806-452655ede0ef None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5e2e51d6-8d31-4abd-b806-452655ede0ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:45.949193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:45.950219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:45.951111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:45.951111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:45.951111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:45.951111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:45.956169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 497/975] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:45.957735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc2cbd-4a73-4b28-8c6a-a2baa154324a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:45.999652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:46.084873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc2cbd-4a73-4b28-8c6a-a2baa154324a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:46.124928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7937f-42c6-4797-a766-f2a0328870f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:46.125605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7937f-42c6-4797-a766-f2a0328870f7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:46.125887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7937f-42c6-4797-a766-f2a0328870f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:46.126165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7937f-42c6-4797-a766-f2a0328870f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:46.126879 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7937f-42c6-4797-a766-f2a0328870f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:46.127692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7937f-42c6-4797-a766-f2a0328870f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:46.129242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7937f-42c6-4797-a766-f2a0328870f7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:46.144147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 479/976] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:46.150139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e51d6-8d31-4abd-b806-452655ede0ef None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:46.267479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e51d6-8d31-4abd-b806-452655ede0ef None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:46.309979 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44993c5-f07e-4df6-be76-a04eb124eacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:46.310636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44993c5-f07e-4df6-be76-a04eb124eacf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:46.310914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44993c5-f07e-4df6-be76-a04eb124eacf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:46.311183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44993c5-f07e-4df6-be76-a04eb124eacf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:46.319518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44993c5-f07e-4df6-be76-a04eb124eacf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:46.320979 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44993c5-f07e-4df6-be76-a04eb124eacf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:46.324124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f44993c5-f07e-4df6-be76-a04eb124eacf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:46.335214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:46.336196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:46.337961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:46.337961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:46.337961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:46.337961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:46.337961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:46.337961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:46.337961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:46.337961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:46.339228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 498/977] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:46.342849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7937f-42c6-4797-a766-f2a0328870f7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:46.484642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:46.491079 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843444-fb5f-4952-b5e6-60cc081b7083 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:46.491757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843444-fb5f-4952-b5e6-60cc081b7083 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:46.492225 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843444-fb5f-4952-b5e6-60cc081b7083 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:46.494266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 499/978] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:46.495636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7937f-42c6-4797-a766-f2a0328870f7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:46.509401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f54c57-5f10-430c-9c45-d1de64ccb105 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:46.509401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f54c57-5f10-430c-9c45-d1de64ccb105 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:46.509401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f54c57-5f10-430c-9c45-d1de64ccb105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:46.522498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-20f54c57-5f10-430c-9c45-d1de64ccb105 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:46.523968 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-20f54c57-5f10-430c-9c45-d1de64ccb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:46.544179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd6cfc-5a17-425a-a613-a6a700caf2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:46.545149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd6cfc-5a17-425a-a613-a6a700caf2dd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:46.545736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd6cfc-5a17-425a-a613-a6a700caf2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:46.546222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd6cfc-5a17-425a-a613-a6a700caf2dd None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:46.547799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd6cfc-5a17-425a-a613-a6a700caf2dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:46.548626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd6cfc-5a17-425a-a613-a6a700caf2dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:46.551455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd6cfc-5a17-425a-a613-a6a700caf2dd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:46.567282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 480/979] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:46.574390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd6cfc-5a17-425a-a613-a6a700caf2dd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:46.606351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 500/980] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:46.630397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f54c57-5f10-430c-9c45-d1de64ccb105 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:46.710397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd6cfc-5a17-425a-a613-a6a700caf2dd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:46.761332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f54c57-5f10-430c-9c45-d1de64ccb105 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:46.762292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdf78b-a9af-4799-a1da-deaf527b0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:46.762912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdf78b-a9af-4799-a1da-deaf527b0e0a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:46.763200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdf78b-a9af-4799-a1da-deaf527b0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:46.763475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdf78b-a9af-4799-a1da-deaf527b0e0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:46.764581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdf78b-a9af-4799-a1da-deaf527b0e0a None admin] RBAC: Adding query filter params (role.id=8785ea09bd024e0ebc5d1b165022df20, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=508186f65cac4ab6b4643d0255725c41) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:46.764581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdf78b-a9af-4799-a1da-deaf527b0e0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:46.766044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdf78b-a9af-4799-a1da-deaf527b0e0a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:46.773713 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 481/981] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:46 2022] GET /identity/v3/role_assignments?user.id=508186f65cac4ab6b4643d0255725c41&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=8785ea09bd024e0ebc5d1b165022df20 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:46.807893 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:46.819837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12eaa4-a485-4c7b-afd0-6dc35e6b00da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:46.819837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12eaa4-a485-4c7b-afd0-6dc35e6b00da None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:46.819837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12eaa4-a485-4c7b-afd0-6dc35e6b00da None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:46.826970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12eaa4-a485-4c7b-afd0-6dc35e6b00da None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:46.826970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12eaa4-a485-4c7b-afd0-6dc35e6b00da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:46.826970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12eaa4-a485-4c7b-afd0-6dc35e6b00da None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:46.903969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 501/982] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:45:46 2022] POST /identity/v3/services => generated 242 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:45:48.010370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbd2e6-9541-4c62-a179-077b24fca432 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.010888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbd2e6-9541-4c62-a179-077b24fca432 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.010966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbd2e6-9541-4c62-a179-077b24fca432 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.012613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 482/983] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:48.018836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa725-1170-487a-b215-87720c03ce7b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.019325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa725-1170-487a-b215-87720c03ce7b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.019685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa725-1170-487a-b215-87720c03ce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.038554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f97aa725-1170-487a-b215-87720c03ce7b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:48.039781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f97aa725-1170-487a-b215-87720c03ce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:48.124602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 502/984] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:48.147506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbd2e6-9541-4c62-a179-077b24fca432 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:48.170314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:48.285548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbd2e6-9541-4c62-a179-077b24fca432 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:48.322637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9713d9-67d8-4862-a9c8-924c194179a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:48.323297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9713d9-67d8-4862-a9c8-924c194179a7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.323582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9713d9-67d8-4862-a9c8-924c194179a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.323857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9713d9-67d8-4862-a9c8-924c194179a7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.324501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9713d9-67d8-4862-a9c8-924c194179a7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:48.325953 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9713d9-67d8-4862-a9c8-924c194179a7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-cd9713d9-67d8-4862-a9c8-924c194179a7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:48.336246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:48.337371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:48.343083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 483/985] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:48.347030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aa725-1170-487a-b215-87720c03ce7b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:48.523728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aa725-1170-487a-b215-87720c03ce7b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:48.554430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:48.577539 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34238d53-9032-41a6-bdac-2a0883028f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:48.578190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34238d53-9032-41a6-bdac-2a0883028f5a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.578486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34238d53-9032-41a6-bdac-2a0883028f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.578846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34238d53-9032-41a6-bdac-2a0883028f5a None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.579809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34238d53-9032-41a6-bdac-2a0883028f5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:48.581049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34238d53-9032-41a6-bdac-2a0883028f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:48.582688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34238d53-9032-41a6-bdac-2a0883028f5a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:48.593287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 503/986] 10.222.0.55 () {56 vars in 1122 bytes} [Mon Jul 25 22:45:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:48.601398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9713d9-67d8-4862-a9c8-924c194179a7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:48.755657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:48.785784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9713d9-67d8-4862-a9c8-924c194179a7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:48.839462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82de56-ba11-4800-9ce1-725ebbd67a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:48.843673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82de56-ba11-4800-9ce1-725ebbd67a86 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.843673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82de56-ba11-4800-9ce1-725ebbd67a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.843673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82de56-ba11-4800-9ce1-725ebbd67a86 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.843673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82de56-ba11-4800-9ce1-725ebbd67a86 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:48.843673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82de56-ba11-4800-9ce1-725ebbd67a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:48.848040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82de56-ba11-4800-9ce1-725ebbd67a86 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:48.861166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 484/987] 10.222.0.55 () {56 vars in 1122 bytes} [Mon Jul 25 22:45:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:48.866190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34238d53-9032-41a6-bdac-2a0883028f5a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:48.918249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c993e6-706b-4ed8-9144-9dbd6c7816bb None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.918569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c993e6-706b-4ed8-9144-9dbd6c7816bb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.918884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c993e6-706b-4ed8-9144-9dbd6c7816bb None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.920313 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 485/988] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:48.926478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30d75e-8f1b-4ff4-822f-f2c4590251c4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.927019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30d75e-8f1b-4ff4-822f-f2c4590251c4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.927301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30d75e-8f1b-4ff4-822f-f2c4590251c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.946350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0c30d75e-8f1b-4ff4-822f-f2c4590251c4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:48.947567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0c30d75e-8f1b-4ff4-822f-f2c4590251c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:49.031586 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 486/989] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:49.034400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32c57-18f5-4cef-ad54-3f481d65e96e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.034859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32c57-18f5-4cef-ad54-3f481d65e96e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.035413 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32c57-18f5-4cef-ad54-3f481d65e96e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.037788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 487/990] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:49.039290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34238d53-9032-41a6-bdac-2a0883028f5a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:49.044553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb3afe-8716-47e0-8f63-dadfbcddc17c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.045002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb3afe-8716-47e0-8f63-dadfbcddc17c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.045457 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb3afe-8716-47e0-8f63-dadfbcddc17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.067287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c9cb3afe-8716-47e0-8f63-dadfbcddc17c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:49.068711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c9cb3afe-8716-47e0-8f63-dadfbcddc17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:49.081303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841db02-c08a-4c50-bcaf-e07ddb62d7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:49.081940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841db02-c08a-4c50-bcaf-e07ddb62d7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.082217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841db02-c08a-4c50-bcaf-e07ddb62d7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.082491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841db02-c08a-4c50-bcaf-e07ddb62d7c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.083264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841db02-c08a-4c50-bcaf-e07ddb62d7c7 None admin] RBAC: Adding query filter params (interface=admin, service_id=90e67507c2f2482a970b5e62dc553434, region_id=RegionOne) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:49.083571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841db02-c08a-4c50-bcaf-e07ddb62d7c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:49.084955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841db02-c08a-4c50-bcaf-e07ddb62d7c7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:49.090686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 504/991] 10.222.0.55 () {56 vars in 1249 bytes} [Mon Jul 25 22:45:48 2022] GET /identity/v3/endpoints?service_id=90e67507c2f2482a970b5e62dc553434&interface=admin®ion_id=RegionOne => generated 193 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:49.091527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841db02-c08a-4c50-bcaf-e07ddb62d7c7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:49.145207 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:49.167185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 488/992] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:49.168156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb3afe-8716-47e0-8f63-dadfbcddc17c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:49.178431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:49.209516 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841db02-c08a-4c50-bcaf-e07ddb62d7c7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:49.251706 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964b97-d1fd-4477-81ae-96bcd5006146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:49.253724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964b97-d1fd-4477-81ae-96bcd5006146 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.253724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964b97-d1fd-4477-81ae-96bcd5006146 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.253724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964b97-d1fd-4477-81ae-96bcd5006146 None admin] PATH_INFO: `/v3/services/image` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.254105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01964b97-d1fd-4477-81ae-96bcd5006146 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:49.255908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01964b97-d1fd-4477-81ae-96bcd5006146 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-01964b97-d1fd-4477-81ae-96bcd5006146 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:49.266570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:49.269470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:49.271371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 505/993] 10.222.0.55 () {56 vars in 1105 bytes} [Mon Jul 25 22:45:49 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:49.273295 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964b97-d1fd-4477-81ae-96bcd5006146 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:49.287282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb3afe-8716-47e0-8f63-dadfbcddc17c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:49.332241 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9ef1f-d495-4687-8a2a-e1b3f0526804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:49.333157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ef1f-d495-4687-8a2a-e1b3f0526804 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.333611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ef1f-d495-4687-8a2a-e1b3f0526804 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.334065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ef1f-d495-4687-8a2a-e1b3f0526804 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.335172 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9ef1f-d495-4687-8a2a-e1b3f0526804 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:49.337368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9ef1f-d495-4687-8a2a-e1b3f0526804 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:49.362815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 489/994] 10.222.0.55 () {56 vars in 1087 bytes} [Mon Jul 25 22:45:49 2022] GET /identity/v3/services => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:45:49.362815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9ef1f-d495-4687-8a2a-e1b3f0526804 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:49.420194 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964b97-d1fd-4477-81ae-96bcd5006146 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:49.437312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:49.478716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:49.480167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeea233-4ac1-4675-b596-638ffa9cff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:49.481072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeea233-4ac1-4675-b596-638ffa9cff2b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.481577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeea233-4ac1-4675-b596-638ffa9cff2b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.482049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeea233-4ac1-4675-b596-638ffa9cff2b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.483169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeea233-4ac1-4675-b596-638ffa9cff2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:49.485675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeea233-4ac1-4675-b596-638ffa9cff2b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-adeea233-4ac1-4675-b596-638ffa9cff2b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:49.501417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:49.503775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:49.504626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 506/995] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:49.513147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeea233-4ac1-4675-b596-638ffa9cff2b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:49.536067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9ef1f-d495-4687-8a2a-e1b3f0526804 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:49.593564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24a838-592d-4f09-a701-f2b49236693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:49.594453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a838-592d-4f09-a701-f2b49236693f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.594935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a838-592d-4f09-a701-f2b49236693f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.595422 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a838-592d-4f09-a701-f2b49236693f None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.596721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24a838-592d-4f09-a701-f2b49236693f None admin] RBAC: Adding query filter params (name=image) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:49.597300 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24a838-592d-4f09-a701-f2b49236693f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:49.599753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24a838-592d-4f09-a701-f2b49236693f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:49.608698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 490/996] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:49.614623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24a838-592d-4f09-a701-f2b49236693f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:49.648498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeea233-4ac1-4675-b596-638ffa9cff2b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:49.692697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ff4cb-6d42-45e4-8382-6de9a41b3acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:49.693408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff4cb-6d42-45e4-8382-6de9a41b3acf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.693683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff4cb-6d42-45e4-8382-6de9a41b3acf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.694371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff4cb-6d42-45e4-8382-6de9a41b3acf None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.694663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ff4cb-6d42-45e4-8382-6de9a41b3acf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:49.694935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ff4cb-6d42-45e4-8382-6de9a41b3acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:49.696371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ff4cb-6d42-45e4-8382-6de9a41b3acf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:49.710514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 507/997] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:49.711956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ff4cb-6d42-45e4-8382-6de9a41b3acf None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:49.758203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24a838-592d-4f09-a701-f2b49236693f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:49.765852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:49.805057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e065a-566f-458f-9419-936be14bcb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:49.805811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e065a-566f-458f-9419-936be14bcb20 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.806106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e065a-566f-458f-9419-936be14bcb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.806387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e065a-566f-458f-9419-936be14bcb20 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.807138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e065a-566f-458f-9419-936be14bcb20 None admin] RBAC: Adding query filter params (type=image) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:49.807442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e065a-566f-458f-9419-936be14bcb20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:49.808976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e065a-566f-458f-9419-936be14bcb20 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:49.810995 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:49.816084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 491/998] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:49.904022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ff4cb-6d42-45e4-8382-6de9a41b3acf None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:49.972197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f8c5b-c43a-468a-b72a-124a17405623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:49.973147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f8c5b-c43a-468a-b72a-124a17405623 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.973657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f8c5b-c43a-468a-b72a-124a17405623 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.974135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f8c5b-c43a-468a-b72a-124a17405623 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.975389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f8c5b-c43a-468a-b72a-124a17405623 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:49.975904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f8c5b-c43a-468a-b72a-124a17405623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:49.978612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f8c5b-c43a-468a-b72a-124a17405623 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:49.987393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 508/999] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:49.994879 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e065a-566f-458f-9419-936be14bcb20 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:50.111292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e065a-566f-458f-9419-936be14bcb20 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:50.151233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd8550-b5b8-4489-aecb-5a9fc11ad8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:50.151868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8550-b5b8-4489-aecb-5a9fc11ad8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:50.152149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8550-b5b8-4489-aecb-5a9fc11ad8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:50.152435 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8550-b5b8-4489-aecb-5a9fc11ad8d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:50.153307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd8550-b5b8-4489-aecb-5a9fc11ad8d5 None admin] RBAC: Adding query filter params (interface=public, service_id=f1976bfe9347405e8c2a72cd197e3730, region_id=RegionOne) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:50.153623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd8550-b5b8-4489-aecb-5a9fc11ad8d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:50.155027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd8550-b5b8-4489-aecb-5a9fc11ad8d5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:50.166600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 492/1000] 10.222.0.55 () {56 vars in 1251 bytes} [Mon Jul 25 22:45:49 2022] GET /identity/v3/endpoints?service_id=f1976bfe9347405e8c2a72cd197e3730&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:50.168576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f8c5b-c43a-468a-b72a-124a17405623 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:50.277152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:50.280770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f8c5b-c43a-468a-b72a-124a17405623 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:50.328159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c2199-0177-49de-8904-9d8baf7ae330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:50.328981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c2199-0177-49de-8904-9d8baf7ae330 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:50.329441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c2199-0177-49de-8904-9d8baf7ae330 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:50.329849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c2199-0177-49de-8904-9d8baf7ae330 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:50.331225 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c2199-0177-49de-8904-9d8baf7ae330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:50.332900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c2199-0177-49de-8904-9d8baf7ae330 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:50.340228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 509/1001] 10.222.0.55 () {56 vars in 1087 bytes} [Mon Jul 25 22:45:50 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:45:51.510273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f440d-8214-4705-8eec-074ffae931f9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:51.511165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f440d-8214-4705-8eec-074ffae931f9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:51.511165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f440d-8214-4705-8eec-074ffae931f9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:51.512421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 493/1002] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:51.519060 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9bf9-2adb-44d8-9d39-e5186e748e1c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:51.519665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9bf9-2adb-44d8-9d39-e5186e748e1c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:51.520324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9bf9-2adb-44d8-9d39-e5186e748e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:51.554825 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-603c9bf9-2adb-44d8-9d39-e5186e748e1c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:51.556934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-603c9bf9-2adb-44d8-9d39-e5186e748e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:51.681202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 510/1003] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:51.706651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f440d-8214-4705-8eec-074ffae931f9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:51.822263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:51.887876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f440d-8214-4705-8eec-074ffae931f9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:51.942536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446dcf0d-28d4-499a-b2f7-98e711efd8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:51.943278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dcf0d-28d4-499a-b2f7-98e711efd8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:51.943559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dcf0d-28d4-499a-b2f7-98e711efd8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:51.943837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dcf0d-28d4-499a-b2f7-98e711efd8f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:51.944554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446dcf0d-28d4-499a-b2f7-98e711efd8f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:51.946180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446dcf0d-28d4-499a-b2f7-98e711efd8f3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-446dcf0d-28d4-499a-b2f7-98e711efd8f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:51.959006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:51.961108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:45:51.963112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:51.966813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 494/1004] 10.222.0.55 () {56 vars in 1126 bytes} [Mon Jul 25 22:45:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:51.968935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c9bf9-2adb-44d8-9d39-e5186e748e1c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:52.090873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d614-fca6-467d-91b6-eb66d52eea7c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:52.091085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d614-fca6-467d-91b6-eb66d52eea7c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:52.091355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d614-fca6-467d-91b6-eb66d52eea7c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:52.092855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 495/1005] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:52.098611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f012b5-1f87-4bb4-bc48-6321601661ee None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:52.098913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f012b5-1f87-4bb4-bc48-6321601661ee None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:52.099165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f012b5-1f87-4bb4-bc48-6321601661ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:52.120558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b7f012b5-1f87-4bb4-bc48-6321601661ee None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:52.122182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b7f012b5-1f87-4bb4-bc48-6321601661ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:52.138338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:52.146487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c9bf9-2adb-44d8-9d39-e5186e748e1c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:52.187657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4ea69-fded-4588-b03d-1506751a992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:52.188294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ea69-fded-4588-b03d-1506751a992c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:52.188567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ea69-fded-4588-b03d-1506751a992c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:52.188836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ea69-fded-4588-b03d-1506751a992c None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:52.189699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4ea69-fded-4588-b03d-1506751a992c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:52.190002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4ea69-fded-4588-b03d-1506751a992c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:52.191544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4ea69-fded-4588-b03d-1506751a992c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:52.197178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 511/1006] 10.222.0.55 () {56 vars in 1122 bytes} [Mon Jul 25 22:45:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:52.202706 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4ea69-fded-4588-b03d-1506751a992c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:52.223669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 496/1007] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:52.246982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f012b5-1f87-4bb4-bc48-6321601661ee None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:52.320678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:52.375802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4ea69-fded-4588-b03d-1506751a992c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:52.404091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f012b5-1f87-4bb4-bc48-6321601661ee None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:52.419789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63097e9-3a10-4fd6-97a6-812a8ebdeba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:52.420488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63097e9-3a10-4fd6-97a6-812a8ebdeba2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:52.420770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63097e9-3a10-4fd6-97a6-812a8ebdeba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:52.421065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63097e9-3a10-4fd6-97a6-812a8ebdeba2 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:52.421874 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63097e9-3a10-4fd6-97a6-812a8ebdeba2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:52.422265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63097e9-3a10-4fd6-97a6-812a8ebdeba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:52.425100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63097e9-3a10-4fd6-97a6-812a8ebdeba2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:52.441615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 512/1008] 10.222.0.55 () {56 vars in 1122 bytes} [Mon Jul 25 22:45:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:52.444308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63097e9-3a10-4fd6-97a6-812a8ebdeba2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:52.452927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427e841-281a-4706-9891-ffe61a333a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:52.453595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427e841-281a-4706-9891-ffe61a333a31 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:52.453865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427e841-281a-4706-9891-ffe61a333a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:52.454255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427e841-281a-4706-9891-ffe61a333a31 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:52.454922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427e841-281a-4706-9891-ffe61a333a31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:52.456472 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427e841-281a-4706-9891-ffe61a333a31 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:52.485614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:52.532889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 497/1009] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:45:52 2022] POST /identity/v3/services => generated 242 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:45:52.535307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1ad66-9d52-4aeb-8ef3-be2096e9695d None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:52.535592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1ad66-9d52-4aeb-8ef3-be2096e9695d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:52.535866 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1ad66-9d52-4aeb-8ef3-be2096e9695d None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:52.537310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 498/1010] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:52.545891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedd5f-9e4e-4090-b477-a88412e3e466 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:52.546465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedd5f-9e4e-4090-b477-a88412e3e466 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:52.546887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedd5f-9e4e-4090-b477-a88412e3e466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:52.576742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9cbedd5f-9e4e-4090-b477-a88412e3e466 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:52.578716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9cbedd5f-9e4e-4090-b477-a88412e3e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:52.605998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63097e9-3a10-4fd6-97a6-812a8ebdeba2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:52.666307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b8b48-9ca4-4ced-ab2a-5b8b2631bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:52.666859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8b48-9ca4-4ced-ab2a-5b8b2631bda8 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:52.667165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8b48-9ca4-4ced-ab2a-5b8b2631bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:52.667437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8b48-9ca4-4ced-ab2a-5b8b2631bda8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:52.668123 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b8b48-9ca4-4ced-ab2a-5b8b2631bda8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:52.669621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b8b48-9ca4-4ced-ab2a-5b8b2631bda8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:52.707214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 499/1011] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:52 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:52.732590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbedd5f-9e4e-4090-b477-a88412e3e466 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:52.752393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 513/1012] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 22:45:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:52.806398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:52.929447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbedd5f-9e4e-4090-b477-a88412e3e466 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:52.992005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610389b-1b7c-4c68-9b6a-c3e7697b5615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:52.992718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610389b-1b7c-4c68-9b6a-c3e7697b5615 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:52.993156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610389b-1b7c-4c68-9b6a-c3e7697b5615 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:52.993318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610389b-1b7c-4c68-9b6a-c3e7697b5615 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:52.993916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610389b-1b7c-4c68-9b6a-c3e7697b5615 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:52.995306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610389b-1b7c-4c68-9b6a-c3e7697b5615 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-3610389b-1b7c-4c68-9b6a-c3e7697b5615 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:53.005114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:53.006627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:53.007622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 500/1013] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:53.012963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b8b48-9ca4-4ced-ab2a-5b8b2631bda8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:53.133756 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:53.167413 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b8b48-9ca4-4ced-ab2a-5b8b2631bda8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:53.220667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c962b-ecf2-4736-a7f2-d863b97e7fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:53.221985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c962b-ecf2-4736-a7f2-d863b97e7fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:53.222472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c962b-ecf2-4736-a7f2-d863b97e7fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:53.222822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c962b-ecf2-4736-a7f2-d863b97e7fe0 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:53.223913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c962b-ecf2-4736-a7f2-d863b97e7fe0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:53.224398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c962b-ecf2-4736-a7f2-d863b97e7fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:53.226161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c962b-ecf2-4736-a7f2-d863b97e7fe0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:53.233465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 514/1014] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:53.240453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610389b-1b7c-4c68-9b6a-c3e7697b5615 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:53.381493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610389b-1b7c-4c68-9b6a-c3e7697b5615 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:53.391477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:53.421954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2b7a6-0435-4deb-b529-d63b9ee8d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:53.422614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2b7a6-0435-4deb-b529-d63b9ee8d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:53.422915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2b7a6-0435-4deb-b529-d63b9ee8d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:53.423131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2b7a6-0435-4deb-b529-d63b9ee8d7e4 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:53.424545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2b7a6-0435-4deb-b529-d63b9ee8d7e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:53.424776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2b7a6-0435-4deb-b529-d63b9ee8d7e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:53.426170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2b7a6-0435-4deb-b529-d63b9ee8d7e4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:53.437360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 501/1015] 10.222.0.55 () {56 vars in 1112 bytes} [Mon Jul 25 22:45:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:53.440452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c962b-ecf2-4736-a7f2-d863b97e7fe0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:53.596777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c962b-ecf2-4736-a7f2-d863b97e7fe0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:53.637917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f099cfc-be6c-44a8-b986-c8a55e7ce094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:53.638637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f099cfc-be6c-44a8-b986-c8a55e7ce094 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:53.638885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f099cfc-be6c-44a8-b986-c8a55e7ce094 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:53.639124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f099cfc-be6c-44a8-b986-c8a55e7ce094 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:53.639848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f099cfc-be6c-44a8-b986-c8a55e7ce094 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:53.641258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f099cfc-be6c-44a8-b986-c8a55e7ce094 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:53.727196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:53.745147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 515/1016] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 22:45:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:54.694451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5061a-1510-47a9-b2d1-78009ebca739 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:54.695026 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5061a-1510-47a9-b2d1-78009ebca739 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:54.695026 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5061a-1510-47a9-b2d1-78009ebca739 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:54.696631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 502/1017] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:54.702107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230dc01-6e32-476b-8dd4-1619c61a0a54 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:54.702521 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230dc01-6e32-476b-8dd4-1619c61a0a54 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:54.702722 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230dc01-6e32-476b-8dd4-1619c61a0a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:54.721228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4230dc01-6e32-476b-8dd4-1619c61a0a54 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:54.722556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4230dc01-6e32-476b-8dd4-1619c61a0a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:54.804934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 516/1018] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:54.827782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5061a-1510-47a9-b2d1-78009ebca739 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:54.941794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5061a-1510-47a9-b2d1-78009ebca739 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:54.946959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7dd8f-7eb7-4228-85ee-336fa37bbf16 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:54.947203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7dd8f-7eb7-4228-85ee-336fa37bbf16 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:54.947458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7dd8f-7eb7-4228-85ee-336fa37bbf16 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:54.949033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 517/1019] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:54.953930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866a13-65d6-437e-934d-70eb98fea5f0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:54.954212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866a13-65d6-437e-934d-70eb98fea5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:54.954428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866a13-65d6-437e-934d-70eb98fea5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:54.975163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9e866a13-65d6-437e-934d-70eb98fea5f0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:54.976486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9e866a13-65d6-437e-934d-70eb98fea5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:54.978328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c129e50-aa0e-46c0-8a3e-d29fe2874106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:54.978966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c129e50-aa0e-46c0-8a3e-d29fe2874106 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:54.979246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c129e50-aa0e-46c0-8a3e-d29fe2874106 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:54.979524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c129e50-aa0e-46c0-8a3e-d29fe2874106 None admin] PATH_INFO: `/v3/services/image` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:54.980146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c129e50-aa0e-46c0-8a3e-d29fe2874106 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:54.981551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c129e50-aa0e-46c0-8a3e-d29fe2874106 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-3c129e50-aa0e-46c0-8a3e-d29fe2874106 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:54.991616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:54.992695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:54.993610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 503/1020] 10.222.0.55 () {56 vars in 1105 bytes} [Mon Jul 25 22:45:54 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:54.998876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c129e50-aa0e-46c0-8a3e-d29fe2874106 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:55.037530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:55.061172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 518/1021] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:55.083188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e866a13-65d6-437e-934d-70eb98fea5f0 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:55.109536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c129e50-aa0e-46c0-8a3e-d29fe2874106 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:55.146980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d4467-ed78-486e-889a-e4310bd9ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:55.147602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d4467-ed78-486e-889a-e4310bd9ba81 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:55.147886 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d4467-ed78-486e-889a-e4310bd9ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:55.148155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d4467-ed78-486e-889a-e4310bd9ba81 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:55.148834 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d4467-ed78-486e-889a-e4310bd9ba81 None admin] RBAC: Adding query filter params (name=image) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:55.149152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d4467-ed78-486e-889a-e4310bd9ba81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:55.150545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d4467-ed78-486e-889a-e4310bd9ba81 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:55.151341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:55.156650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 504/1022] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:55.163587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d4467-ed78-486e-889a-e4310bd9ba81 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:55.203624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e866a13-65d6-437e-934d-70eb98fea5f0 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:55.252911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc718c89-32c5-4f40-a051-05b7e6e30440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:55.255178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc718c89-32c5-4f40-a051-05b7e6e30440 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:55.256200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc718c89-32c5-4f40-a051-05b7e6e30440 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:55.256827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc718c89-32c5-4f40-a051-05b7e6e30440 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:55.260202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc718c89-32c5-4f40-a051-05b7e6e30440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:55.263422 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc718c89-32c5-4f40-a051-05b7e6e30440 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:55.266936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 519/1023] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:55.273111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc718c89-32c5-4f40-a051-05b7e6e30440 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:55.278387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:55.286843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d4467-ed78-486e-889a-e4310bd9ba81 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:55.340526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d1b46-ccc2-4370-bc9c-156c4b435b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:55.341179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d1b46-ccc2-4370-bc9c-156c4b435b25 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:55.341468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d1b46-ccc2-4370-bc9c-156c4b435b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:55.341757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d1b46-ccc2-4370-bc9c-156c4b435b25 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:55.342542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d1b46-ccc2-4370-bc9c-156c4b435b25 None admin] RBAC: Adding query filter params (type=image) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:55.342857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d1b46-ccc2-4370-bc9c-156c4b435b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:55.344263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d1b46-ccc2-4370-bc9c-156c4b435b25 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:55.351191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 505/1024] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:55.358361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d1b46-ccc2-4370-bc9c-156c4b435b25 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:55.435214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc718c89-32c5-4f40-a051-05b7e6e30440 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:55.461849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:55.474724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94affbd-505a-4e0e-97a2-ad3c060e32e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:55.475359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94affbd-505a-4e0e-97a2-ad3c060e32e7 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:55.475642 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94affbd-505a-4e0e-97a2-ad3c060e32e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:55.475915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94affbd-505a-4e0e-97a2-ad3c060e32e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:55.476612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94affbd-505a-4e0e-97a2-ad3c060e32e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:55.478109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94affbd-505a-4e0e-97a2-ad3c060e32e7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:55.496078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d1b46-ccc2-4370-bc9c-156c4b435b25 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:55.535471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9ccf8-c13b-4768-9ab8-902848c257e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:55.536093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9ccf8-c13b-4768-9ab8-902848c257e0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:55.536375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9ccf8-c13b-4768-9ab8-902848c257e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:55.536645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9ccf8-c13b-4768-9ab8-902848c257e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:55.537441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9ccf8-c13b-4768-9ab8-902848c257e0 None admin] RBAC: Adding query filter params (interface=public, service_id=41c3e3694d7a455aa9472e644e856787, region_id=RegionOne) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:55.537748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9ccf8-c13b-4768-9ab8-902848c257e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:55.539136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9ccf8-c13b-4768-9ab8-902848c257e0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:55.545270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 506/1025] 10.222.0.55 () {56 vars in 1251 bytes} [Mon Jul 25 22:45:55 2022] GET /identity/v3/endpoints?service_id=41c3e3694d7a455aa9472e644e856787&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:55.552128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9ccf8-c13b-4768-9ab8-902848c257e0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:55.583943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:55.588026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 520/1026] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:45:55 2022] POST /identity/v3/projects => generated 311 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:45:55.691003 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9ccf8-c13b-4768-9ab8-902848c257e0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:55.732380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6873b-5eb0-4719-b62f-16b45c908d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:55.733106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6873b-5eb0-4719-b62f-16b45c908d34 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:55.733371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6873b-5eb0-4719-b62f-16b45c908d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:55.733543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6873b-5eb0-4719-b62f-16b45c908d34 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:55.734203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6873b-5eb0-4719-b62f-16b45c908d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:55.735613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6873b-5eb0-4719-b62f-16b45c908d34 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:55.749430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 507/1027] 10.222.0.55 () {56 vars in 1087 bytes} [Mon Jul 25 22:45:55 2022] GET /identity/v3/services => generated 1957 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:45:55.994579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722fe6a-9f10-4f21-adfd-ba7f8c653f84 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:55.995115 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722fe6a-9f10-4f21-adfd-ba7f8c653f84 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:55.995498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722fe6a-9f10-4f21-adfd-ba7f8c653f84 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:55.998145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 521/1028] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:56.005316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1e70b-3016-4437-b42d-4ce84acc165b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:56.005767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1e70b-3016-4437-b42d-4ce84acc165b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:56.006176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1e70b-3016-4437-b42d-4ce84acc165b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:56.028700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fcc1e70b-3016-4437-b42d-4ce84acc165b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:56.030027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fcc1e70b-3016-4437-b42d-4ce84acc165b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:56.139271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 508/1029] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:56.169647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722fe6a-9f10-4f21-adfd-ba7f8c653f84 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:56.342517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722fe6a-9f10-4f21-adfd-ba7f8c653f84 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:56.400013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1a9cf-3872-4b98-8c17-a2f4bd36bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:56.400857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1a9cf-3872-4b98-8c17-a2f4bd36bb61 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:56.401183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1a9cf-3872-4b98-8c17-a2f4bd36bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:56.401525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1a9cf-3872-4b98-8c17-a2f4bd36bb61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:56.416797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1a9cf-3872-4b98-8c17-a2f4bd36bb61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-47f1a9cf-3872-4b98-8c17-a2f4bd36bb61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:45:56.423078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:56.433607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:56.435769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 522/1030] 10.222.0.55 () {56 vars in 1120 bytes} [Mon Jul 25 22:45:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:56.442870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1e70b-3016-4437-b42d-4ce84acc165b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:56.482822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:56.615592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1e70b-3016-4437-b42d-4ce84acc165b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:56.678237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061764f-a547-42cb-93c8-7c8390630989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:56.679258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061764f-a547-42cb-93c8-7c8390630989 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:56.680268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061764f-a547-42cb-93c8-7c8390630989 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:56.680268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061764f-a547-42cb-93c8-7c8390630989 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:56.681862 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061764f-a547-42cb-93c8-7c8390630989 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:56.682348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061764f-a547-42cb-93c8-7c8390630989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:56.684470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061764f-a547-42cb-93c8-7c8390630989 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:56.706663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 509/1031] 10.222.0.55 () {56 vars in 1115 bytes} [Mon Jul 25 22:45:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:56.709182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1a9cf-3872-4b98-8c17-a2f4bd36bb61 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:56.768534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:56.888038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1a9cf-3872-4b98-8c17-a2f4bd36bb61 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:56.934760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dce59-4ac2-4a91-88bc-dc8b7bd7e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:56.935431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dce59-4ac2-4a91-88bc-dc8b7bd7e6fc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:56.935711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dce59-4ac2-4a91-88bc-dc8b7bd7e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:56.935982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dce59-4ac2-4a91-88bc-dc8b7bd7e6fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:56.948685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dce59-4ac2-4a91-88bc-dc8b7bd7e6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:56.950218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dce59-4ac2-4a91-88bc-dc8b7bd7e6fc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-657dce59-4ac2-4a91-88bc-dc8b7bd7e6fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:56.968440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:56.970382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:56.974789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:56.974789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:56.974789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:56.974789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:56.975636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 523/1032] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:56.976772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061764f-a547-42cb-93c8-7c8390630989 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:57.068592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:57.088360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061764f-a547-42cb-93c8-7c8390630989 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:57.126159 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc7b43-a129-4170-997b-5c08c40fbb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:57.126773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7b43-a129-4170-997b-5c08c40fbb7e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.127983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7b43-a129-4170-997b-5c08c40fbb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.128250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7b43-a129-4170-997b-5c08c40fbb7e None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.128941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc7b43-a129-4170-997b-5c08c40fbb7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:57.129272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc7b43-a129-4170-997b-5c08c40fbb7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:57.130644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc7b43-a129-4170-997b-5c08c40fbb7e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:57.144307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 510/1033] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:57.149843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dce59-4ac2-4a91-88bc-dc8b7bd7e6fc None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:57.247980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:57.265166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dce59-4ac2-4a91-88bc-dc8b7bd7e6fc None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:57.303579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8739-b955-4410-874d-7c6c7c4056f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:57.304613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8739-b955-4410-874d-7c6c7c4056f8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.305089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8739-b955-4410-874d-7c6c7c4056f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.305592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8739-b955-4410-874d-7c6c7c4056f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.316718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b8739-b955-4410-874d-7c6c7c4056f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:57.318439 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b8739-b955-4410-874d-7c6c7c4056f8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-337b8739-b955-4410-874d-7c6c7c4056f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:45:57.332455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:57.334457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:57.336372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:57.336372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:57.336372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:45:57.336372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:45:57.336372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:45:57.336372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:45:57.336372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:45:57.336372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:45:57.336372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:45:57.336372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:57.339126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 524/1034] 10.222.0.55 () {56 vars in 1093 bytes} [Mon Jul 25 22:45:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:57.340135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc7b43-a129-4170-997b-5c08c40fbb7e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:57.472247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc7b43-a129-4170-997b-5c08c40fbb7e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:57.511849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c97adb-7a97-438c-b30e-68d5f95f61c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:57.512492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c97adb-7a97-438c-b30e-68d5f95f61c4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.512770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c97adb-7a97-438c-b30e-68d5f95f61c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.513046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c97adb-7a97-438c-b30e-68d5f95f61c4 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.513900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c97adb-7a97-438c-b30e-68d5f95f61c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:57.514208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c97adb-7a97-438c-b30e-68d5f95f61c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:57.515795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c97adb-7a97-438c-b30e-68d5f95f61c4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:57.534225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:57.539793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 511/1035] 10.222.0.55 () {56 vars in 1133 bytes} [Mon Jul 25 22:45:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:57.545644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8739-b955-4410-874d-7c6c7c4056f8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:57.667265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8739-b955-4410-874d-7c6c7c4056f8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:57.706844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d8703-0407-4602-9200-6cd88dc07214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:57.707631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d8703-0407-4602-9200-6cd88dc07214 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.708042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d8703-0407-4602-9200-6cd88dc07214 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.708437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d8703-0407-4602-9200-6cd88dc07214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.726708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:57.792548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d8703-0407-4602-9200-6cd88dc07214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:57.794164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d8703-0407-4602-9200-6cd88dc07214 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:57.895028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a8f5-b41c-4ac3-9ea1-77116f10c06f None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.895286 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a8f5-b41c-4ac3-9ea1-77116f10c06f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.895625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a8f5-b41c-4ac3-9ea1-77116f10c06f None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.897175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 512/1036] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:57.903087 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf8122-3f79-43ef-a71f-2ec5d6a4c3e3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.903489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf8122-3f79-43ef-a71f-2ec5d6a4c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.903651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf8122-3f79-43ef-a71f-2ec5d6a4c3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.925899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f6bf8122-3f79-43ef-a71f-2ec5d6a4c3e3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:57.928298 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f6bf8122-3f79-43ef-a71f-2ec5d6a4c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:57.952747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 525/1037] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:45:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:45:57.959826 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d8703-0407-4602-9200-6cd88dc07214 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.014296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:58.041857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 513/1038] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:45:58.043636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc140ddd-aef0-4d9e-8dcf-ef893e6637dd None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.044122 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc140ddd-aef0-4d9e-8dcf-ef893e6637dd None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.044612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc140ddd-aef0-4d9e-8dcf-ef893e6637dd None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.047128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 514/1039] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:45:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:58.054057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc5177-8573-4209-a21d-a4afb8fc295b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.054723 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc5177-8573-4209-a21d-a4afb8fc295b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.055002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc5177-8573-4209-a21d-a4afb8fc295b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.079710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-98dc5177-8573-4209-a21d-a4afb8fc295b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:58.081617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-98dc5177-8573-4209-a21d-a4afb8fc295b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:58.089052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d8703-0407-4602-9200-6cd88dc07214 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:58.131626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af863-1fdb-434c-adc4-c901e700b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:58.132279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af863-1fdb-434c-adc4-c901e700b838 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.132566 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af863-1fdb-434c-adc4-c901e700b838 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.132840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af863-1fdb-434c-adc4-c901e700b838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.146434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9af863-1fdb-434c-adc4-c901e700b838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:58.149235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9af863-1fdb-434c-adc4-c901e700b838 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:58.161965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 515/1040] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:45:58.163470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc5177-8573-4209-a21d-a4afb8fc295b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4c9af863-1fdb-434c-adc4-c901e700b838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:45:58.167654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:58.170089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:58.171008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:45:58.171008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:45:58.171008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:45:58.171008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:45:58.171008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 526/1041] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:45:58.179611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af863-1fdb-434c-adc4-c901e700b838 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.252549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:58.297811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc5177-8573-4209-a21d-a4afb8fc295b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:58.298104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:58.302617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af863-1fdb-434c-adc4-c901e700b838 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:58.339123 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce330a-c957-4544-8c1d-db04c833128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:58.339767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce330a-c957-4544-8c1d-db04c833128d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.340048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce330a-c957-4544-8c1d-db04c833128d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.340319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce330a-c957-4544-8c1d-db04c833128d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.341540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce330a-c957-4544-8c1d-db04c833128d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:58.341694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15309272-c773-409e-9986-11f069073d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:58.342355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15309272-c773-409e-9986-11f069073d03 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.342650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15309272-c773-409e-9986-11f069073d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.342917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15309272-c773-409e-9986-11f069073d03 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.343169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce330a-c957-4544-8c1d-db04c833128d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:58.343616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15309272-c773-409e-9986-11f069073d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:58.343920 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15309272-c773-409e-9986-11f069073d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:58.344785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 516/1042] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:58.345325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15309272-c773-409e-9986-11f069073d03 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:58.346341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce330a-c957-4544-8c1d-db04c833128d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.358649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 527/1043] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:58.359491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15309272-c773-409e-9986-11f069073d03 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.471933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15309272-c773-409e-9986-11f069073d03 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:58.484367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce330a-c957-4544-8c1d-db04c833128d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:58.515577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2969dfc-6048-4ce3-831a-8f146c1d701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:58.515870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:58.516359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2969dfc-6048-4ce3-831a-8f146c1d701a None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.516717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2969dfc-6048-4ce3-831a-8f146c1d701a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.517011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2969dfc-6048-4ce3-831a-8f146c1d701a None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.518206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2969dfc-6048-4ce3-831a-8f146c1d701a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:58.519830 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2969dfc-6048-4ce3-831a-8f146c1d701a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:58.525805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225ab66-f100-415c-9791-2ced528a1946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:58.526461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225ab66-f100-415c-9791-2ced528a1946 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.529725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225ab66-f100-415c-9791-2ced528a1946 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.529725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225ab66-f100-415c-9791-2ced528a1946 None admin] PATH_INFO: `/v3/services/image` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.529725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225ab66-f100-415c-9791-2ced528a1946 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:58.529725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225ab66-f100-415c-9791-2ced528a1946 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-a225ab66-f100-415c-9791-2ced528a1946 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:58.540784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:58.542815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:58.544491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 517/1044] 10.222.0.55 () {56 vars in 1105 bytes} [Mon Jul 25 22:45:58 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:58.546074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225ab66-f100-415c-9791-2ced528a1946 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.606600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 528/1045] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:45:58 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:45:58.607442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2969dfc-6048-4ce3-831a-8f146c1d701a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.627752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:58.670896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225ab66-f100-415c-9791-2ced528a1946 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:58.722932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb67ff-0c14-4713-988b-0529c9d619ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:58.723622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb67ff-0c14-4713-988b-0529c9d619ae None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.723911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb67ff-0c14-4713-988b-0529c9d619ae None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.724214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb67ff-0c14-4713-988b-0529c9d619ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.732288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb67ff-0c14-4713-988b-0529c9d619ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:58.733916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb67ff-0c14-4713-988b-0529c9d619ae None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-38eb67ff-0c14-4713-988b-0529c9d619ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:45:58.748615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:45:58.750236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:45:58.751395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:45:58.751395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:45:58.751395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:45:58.751395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:45:58.751395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:45:58.751395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:45:58.751395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:45:58.751395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:45:58.751395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 518/1046] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:45:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:45:58.757157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb67ff-0c14-4713-988b-0529c9d619ae None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.771338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2969dfc-6048-4ce3-831a-8f146c1d701a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:58.817190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2da24-0ca8-4244-87cb-a3f4300e36d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:58.818471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2da24-0ca8-4244-87cb-a3f4300e36d7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.819035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2da24-0ca8-4244-87cb-a3f4300e36d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.819445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2da24-0ca8-4244-87cb-a3f4300e36d7 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.820280 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2da24-0ca8-4244-87cb-a3f4300e36d7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:58.821326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2da24-0ca8-4244-87cb-a3f4300e36d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:58.822951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2da24-0ca8-4244-87cb-a3f4300e36d7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:58.831695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 529/1047] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:45:58.838343 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:58.841767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2da24-0ca8-4244-87cb-a3f4300e36d7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.920255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb67ff-0c14-4713-988b-0529c9d619ae None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:58.946575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:58.978115 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7b3a0-637d-4f79-b7e5-162089988f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:58.978756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7b3a0-637d-4f79-b7e5-162089988f0f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.979043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7b3a0-637d-4f79-b7e5-162089988f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.979327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7b3a0-637d-4f79-b7e5-162089988f0f None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.980076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7b3a0-637d-4f79-b7e5-162089988f0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:58.980409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7b3a0-637d-4f79-b7e5-162089988f0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:58.980799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2da24-0ca8-4244-87cb-a3f4300e36d7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:58.982085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7b3a0-637d-4f79-b7e5-162089988f0f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:58.998187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 519/1048] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:45:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:59.004616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7b3a0-637d-4f79-b7e5-162089988f0f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:59.047628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e7fe-1682-49ac-aefb-871bf269e84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:59.049659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e7fe-1682-49ac-aefb-871bf269e84a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:59.049972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e7fe-1682-49ac-aefb-871bf269e84a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:59.050283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e7fe-1682-49ac-aefb-871bf269e84a None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:59.051739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e7fe-1682-49ac-aefb-871bf269e84a None admin] RBAC: Adding query filter params (type=image) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:59.052299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e7fe-1682-49ac-aefb-871bf269e84a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:59.054964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e7fe-1682-49ac-aefb-871bf269e84a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:59.064372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 530/1049] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:45:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:59.075285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e7fe-1682-49ac-aefb-871bf269e84a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:59.148650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7b3a0-637d-4f79-b7e5-162089988f0f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:59.172924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:59.211825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa16cb-6374-46b6-8bd6-9bc5451d1365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:59.212871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa16cb-6374-46b6-8bd6-9bc5451d1365 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:59.213410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa16cb-6374-46b6-8bd6-9bc5451d1365 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:59.213897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa16cb-6374-46b6-8bd6-9bc5451d1365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:59.215489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa16cb-6374-46b6-8bd6-9bc5451d1365 None admin] RBAC: Adding query filter params (role.id=8785ea09bd024e0ebc5d1b165022df20, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=eea60163008a4bea95d130a5809fc50d) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:45:59.216044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa16cb-6374-46b6-8bd6-9bc5451d1365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:59.218830 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa16cb-6374-46b6-8bd6-9bc5451d1365 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:59.223300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e7fe-1682-49ac-aefb-871bf269e84a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:59.229773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 520/1050] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:45:59 2022] GET /identity/v3/role_assignments?user.id=eea60163008a4bea95d130a5809fc50d&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=8785ea09bd024e0ebc5d1b165022df20 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:45:59.267418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc1155-43d9-4baf-ad05-563e28f14ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:59.268845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc1155-43d9-4baf-ad05-563e28f14ed2 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:59.269331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc1155-43d9-4baf-ad05-563e28f14ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:59.269757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc1155-43d9-4baf-ad05-563e28f14ed2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:59.270674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc1155-43d9-4baf-ad05-563e28f14ed2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:59.272260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc1155-43d9-4baf-ad05-563e28f14ed2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:59.345054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:59.357163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 531/1051] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 22:45:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:46:01.440266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60267f-cb5f-4573-9efd-40a6bbd30285 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:01.440829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60267f-cb5f-4573-9efd-40a6bbd30285 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:01.441068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60267f-cb5f-4573-9efd-40a6bbd30285 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:01.442592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 521/1052] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:46:01.449187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b0519-8465-4a5a-a1f0-c2866130933a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:01.449703 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b0519-8465-4a5a-a1f0-c2866130933a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:01.449781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b0519-8465-4a5a-a1f0-c2866130933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:01.475771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ae1b0519-8465-4a5a-a1f0-c2866130933a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:01.477053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ae1b0519-8465-4a5a-a1f0-c2866130933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:01.500095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee645c-1c28-427e-a5d5-53a3dc4c6148 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:01.500383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee645c-1c28-427e-a5d5-53a3dc4c6148 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:01.500719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee645c-1c28-427e-a5d5-53a3dc4c6148 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:01.502877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 522/1053] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:01.508078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206a36-868b-48a0-afb9-f701f130fb03 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:01.508367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206a36-868b-48a0-afb9-f701f130fb03 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:01.508648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206a36-868b-48a0-afb9-f701f130fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:01.527711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f0206a36-868b-48a0-afb9-f701f130fb03 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:01.528935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f0206a36-868b-48a0-afb9-f701f130fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:01.579416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 532/1054] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:46:01.602309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b0519-8465-4a5a-a1f0-c2866130933a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:01.625164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 523/1055] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:46:01.649683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206a36-868b-48a0-afb9-f701f130fb03 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:01.733452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b0519-8465-4a5a-a1f0-c2866130933a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:01.769324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:01.775928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206a36-868b-48a0-afb9-f701f130fb03 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:01.783322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46355d83-197a-4d8a-bc9a-0a6740e7c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:01.783633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355d83-197a-4d8a-bc9a-0a6740e7c657 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:01.784640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:01.784808 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355d83-197a-4d8a-bc9a-0a6740e7c657 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:01.785073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355d83-197a-4d8a-bc9a-0a6740e7c657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:01.818556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4837545-ab04-47f5-80fa-e09031a80b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:01.819229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4837545-ab04-47f5-80fa-e09031a80b4c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:01.819518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4837545-ab04-47f5-80fa-e09031a80b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:01.819883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4837545-ab04-47f5-80fa-e09031a80b4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:01.834676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4837545-ab04-47f5-80fa-e09031a80b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f4837545-ab04-47f5-80fa-e09031a80b4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:01.839717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:01.840698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:01.841721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 524/1056] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:46:01.849634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4837545-ab04-47f5-80fa-e09031a80b4c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:01.882314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46355d83-197a-4d8a-bc9a-0a6740e7c657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:01.883887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46355d83-197a-4d8a-bc9a-0a6740e7c657 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:01.974977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4837545-ab04-47f5-80fa-e09031a80b4c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:02.018138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65094-4d91-48ec-8dcf-f890af33376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:02.024474 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 533/1057] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:46:02.024661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65094-4d91-48ec-8dcf-f890af33376e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.024770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78617e63-754f-477e-b0d5-b0e5fab11814 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.024869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65094-4d91-48ec-8dcf-f890af33376e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.024946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78617e63-754f-477e-b0d5-b0e5fab11814 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.025030 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65094-4d91-48ec-8dcf-f890af33376e None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.025101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78617e63-754f-477e-b0d5-b0e5fab11814 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.025197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65094-4d91-48ec-8dcf-f890af33376e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:02.025279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 534/1058] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:02.025350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65094-4d91-48ec-8dcf-f890af33376e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:02.025350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65094-4d91-48ec-8dcf-f890af33376e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:02.025739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78617e63-754f-477e-b0d5-b0e5fab11814 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:02.035507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 525/1059] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:02.036756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fd7aa-2194-4d6d-b869-ef972bd93866 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.037044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fd7aa-2194-4d6d-b869-ef972bd93866 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.037339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fd7aa-2194-4d6d-b869-ef972bd93866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.055842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5d8fd7aa-2194-4d6d-b869-ef972bd93866 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:02.057050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5d8fd7aa-2194-4d6d-b869-ef972bd93866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:02.059857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:02.082508 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:02.161165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 526/1060] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:02.161165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fd7aa-2194-4d6d-b869-ef972bd93866 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:02.168428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78617e63-754f-477e-b0d5-b0e5fab11814 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:02.210634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc908d0a-1a21-4a66-b5fa-ae6baa588a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:02.211280 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc908d0a-1a21-4a66-b5fa-ae6baa588a64 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.211560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc908d0a-1a21-4a66-b5fa-ae6baa588a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.211835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc908d0a-1a21-4a66-b5fa-ae6baa588a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.222552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc908d0a-1a21-4a66-b5fa-ae6baa588a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:02.224055 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc908d0a-1a21-4a66-b5fa-ae6baa588a64 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-bc908d0a-1a21-4a66-b5fa-ae6baa588a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:46:02.240589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:02.241807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:02.243044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:46:02.243044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:46:02.243044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:02.243044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:02.243044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 535/1061] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:02.243044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc908d0a-1a21-4a66-b5fa-ae6baa588a64 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:02.290897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fd7aa-2194-4d6d-b869-ef972bd93866 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:02.378423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:02.403033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc908d0a-1a21-4a66-b5fa-ae6baa588a64 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:02.405420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429e414-f145-4a0c-b3d3-6750f494e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:02.406142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429e414-f145-4a0c-b3d3-6750f494e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.406421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429e414-f145-4a0c-b3d3-6750f494e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.406692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429e414-f145-4a0c-b3d3-6750f494e4d6 None admin] PATH_INFO: `/v3/users/ec0e69d914de4805aefa0a4b95147dcc` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.421889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429e414-f145-4a0c-b3d3-6750f494e4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e69d914de4805aefa0a4b95147dcc)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:02.423441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429e414-f145-4a0c-b3d3-6750f494e4d6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:02.425839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 527/1062] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:02 2022] GET /identity/v3/users/ec0e69d914de4805aefa0a4b95147dcc => generated 285 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:02.426949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429e414-f145-4a0c-b3d3-6750f494e4d6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:02.439292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80dc4-1515-4fb2-90fe-c2de2eef7f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:02.439950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80dc4-1515-4fb2-90fe-c2de2eef7f74 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.447909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80dc4-1515-4fb2-90fe-c2de2eef7f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.447909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80dc4-1515-4fb2-90fe-c2de2eef7f74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.450402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:02.452550 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def80dc4-1515-4fb2-90fe-c2de2eef7f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-def80dc4-1515-4fb2-90fe-c2de2eef7f74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:02.458287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:02.459771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 536/1063] 10.222.0.55 () {56 vars in 1120 bytes} [Mon Jul 25 22:46:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:02.460628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80dc4-1515-4fb2-90fe-c2de2eef7f74 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:02.549573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429e414-f145-4a0c-b3d3-6750f494e4d6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:02.579521 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80dc4-1515-4fb2-90fe-c2de2eef7f74 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:02.590745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a9367-494f-41f4-905c-f682d510a3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:02.591371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a9367-494f-41f4-905c-f682d510a3db None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.591649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a9367-494f-41f4-905c-f682d510a3db None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.591986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a9367-494f-41f4-905c-f682d510a3db None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.592685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a9367-494f-41f4-905c-f682d510a3db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:02.592984 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a9367-494f-41f4-905c-f682d510a3db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:02.594411 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a9367-494f-41f4-905c-f682d510a3db None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:02.607432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 528/1064] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:02.608320 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a9367-494f-41f4-905c-f682d510a3db None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:02.632787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1c78-166d-4084-a28b-efca202b0fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:02.633702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1c78-166d-4084-a28b-efca202b0fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.634133 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1c78-166d-4084-a28b-efca202b0fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.634546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1c78-166d-4084-a28b-efca202b0fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.640766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:02.724303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc1c78-166d-4084-a28b-efca202b0fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:02.726133 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc1c78-166d-4084-a28b-efca202b0fb6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:02.745561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:02.782169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a9367-494f-41f4-905c-f682d510a3db None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:02.841487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e2e23-a1e4-49b5-b4ef-2eba10867e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:02.842029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e2e23-a1e4-49b5-b4ef-2eba10867e9a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.842328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e2e23-a1e4-49b5-b4ef-2eba10867e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.842635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e2e23-a1e4-49b5-b4ef-2eba10867e9a None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.843802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e2e23-a1e4-49b5-b4ef-2eba10867e9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:02.844115 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e2e23-a1e4-49b5-b4ef-2eba10867e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:02.845956 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e2e23-a1e4-49b5-b4ef-2eba10867e9a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:02.862433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 529/1065] 10.222.0.55 () {56 vars in 1115 bytes} [Mon Jul 25 22:46:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:02.863551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e2e23-a1e4-49b5-b4ef-2eba10867e9a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:02.882475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 537/1066] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:46:02.889490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1c78-166d-4084-a28b-efca202b0fb6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:02.951985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:03.018817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e2e23-a1e4-49b5-b4ef-2eba10867e9a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:03.030093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1c78-166d-4084-a28b-efca202b0fb6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:03.057140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8bf63-7bb9-47f9-8028-6ade5ff90795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:03.057792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8bf63-7bb9-47f9-8028-6ade5ff90795 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.058071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8bf63-7bb9-47f9-8028-6ade5ff90795 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.058350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8bf63-7bb9-47f9-8028-6ade5ff90795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.066745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:03.073142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8bf63-7bb9-47f9-8028-6ade5ff90795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:03.073958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152c968-6f1d-4725-aceb-1d5c57161480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:03.074609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152c968-6f1d-4725-aceb-1d5c57161480 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.074888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152c968-6f1d-4725-aceb-1d5c57161480 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.075161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152c968-6f1d-4725-aceb-1d5c57161480 None admin] PATH_INFO: `/v3/projects/e5ebf1abdb5142c5b621885875bc9527` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.075737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8bf63-7bb9-47f9-8028-6ade5ff90795 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:03.076445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152c968-6f1d-4725-aceb-1d5c57161480 None admin] RBAC: Authorizing `identity:get_project(project_id=e5ebf1abdb5142c5b621885875bc9527)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:03.077934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152c968-6f1d-4725-aceb-1d5c57161480 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:03.079673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 538/1067] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:02 2022] GET /identity/v3/projects/e5ebf1abdb5142c5b621885875bc9527 => generated 311 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:03.089689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152c968-6f1d-4725-aceb-1d5c57161480 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-78c8bf63-7bb9-47f9-8028-6ade5ff90795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:46:03.095617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:03.097571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:03.099663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:46:03.099663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:46:03.099663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:03.099663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:03.101696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 530/1068] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:03.106544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8bf63-7bb9-47f9-8028-6ade5ff90795 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:03.220348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152c968-6f1d-4725-aceb-1d5c57161480 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:03.223557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:03.234511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8bf63-7bb9-47f9-8028-6ade5ff90795 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:03.268373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee6a3-8188-4003-95a2-3f4598555282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:03.269265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee6a3-8188-4003-95a2-3f4598555282 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.269545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee6a3-8188-4003-95a2-3f4598555282 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.269815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee6a3-8188-4003-95a2-3f4598555282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.270603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ee6a3-8188-4003-95a2-3f4598555282 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=e5ebf1abdb5142c5b621885875bc9527, user.id=ec0e69d914de4805aefa0a4b95147dcc) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:03.270908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ee6a3-8188-4003-95a2-3f4598555282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:03.272319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ee6a3-8188-4003-95a2-3f4598555282 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:03.278101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 539/1069] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:46:03 2022] GET /identity/v3/role_assignments?user.id=ec0e69d914de4805aefa0a4b95147dcc&scope.project.id=e5ebf1abdb5142c5b621885875bc9527&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:03.281543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf32d1-7684-4c07-977d-a71aeeb4af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:03.282499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf32d1-7684-4c07-977d-a71aeeb4af5a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.283527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf32d1-7684-4c07-977d-a71aeeb4af5a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.283954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf32d1-7684-4c07-977d-a71aeeb4af5a None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.285044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf32d1-7684-4c07-977d-a71aeeb4af5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:03.285564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf32d1-7684-4c07-977d-a71aeeb4af5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:03.287965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf32d1-7684-4c07-977d-a71aeeb4af5a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:03.306433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 531/1070] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:03.315158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee6a3-8188-4003-95a2-3f4598555282 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:03.466766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee6a3-8188-4003-95a2-3f4598555282 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:03.508834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e56a22-1d65-48c6-a105-5b96d26d34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:03.509554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e56a22-1d65-48c6-a105-5b96d26d34fa None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.509839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e56a22-1d65-48c6-a105-5b96d26d34fa None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.510114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e56a22-1d65-48c6-a105-5b96d26d34fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.519677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e56a22-1d65-48c6-a105-5b96d26d34fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:03.521287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e56a22-1d65-48c6-a105-5b96d26d34fa None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-09e56a22-1d65-48c6-a105-5b96d26d34fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:46:03.536263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:03.537666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:03.538851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 540/1071] 10.222.0.55 () {56 vars in 1093 bytes} [Mon Jul 25 22:46:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:03.544759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf32d1-7684-4c07-977d-a71aeeb4af5a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:03.608802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:03.671189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf32d1-7684-4c07-977d-a71aeeb4af5a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:03.711983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165720df-e311-4cd2-b25f-02459e883fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:03.712609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165720df-e311-4cd2-b25f-02459e883fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.712895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165720df-e311-4cd2-b25f-02459e883fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.713202 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165720df-e311-4cd2-b25f-02459e883fe3 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.714013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165720df-e311-4cd2-b25f-02459e883fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:03.714321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165720df-e311-4cd2-b25f-02459e883fe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:03.715964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165720df-e311-4cd2-b25f-02459e883fe3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:03.737101 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 532/1072] 10.222.0.55 () {56 vars in 1133 bytes} [Mon Jul 25 22:46:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:03.744114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e56a22-1d65-48c6-a105-5b96d26d34fa None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:03.788871 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:03.871169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e56a22-1d65-48c6-a105-5b96d26d34fa None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:03.907215 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcf689-4f3c-4839-bd9e-e9c98252d085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:03.907864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcf689-4f3c-4839-bd9e-e9c98252d085 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.908645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcf689-4f3c-4839-bd9e-e9c98252d085 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.908926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcf689-4f3c-4839-bd9e-e9c98252d085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.921833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fcf689-4f3c-4839-bd9e-e9c98252d085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:03.923388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fcf689-4f3c-4839-bd9e-e9c98252d085 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-14fcf689-4f3c-4839-bd9e-e9c98252d085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:46:03.945561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:03.946618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:03.947505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:46:03.947505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:46:03.947505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:03.947505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:03.949299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 541/1073] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:03.953337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165720df-e311-4cd2-b25f-02459e883fe3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:04.061474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165720df-e311-4cd2-b25f-02459e883fe3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:04.074573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:04.101585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b2d4-bb71-4446-b793-50ed3f61432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:04.102194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b2d4-bb71-4446-b793-50ed3f61432f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:04.102577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b2d4-bb71-4446-b793-50ed3f61432f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:04.102968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b2d4-bb71-4446-b793-50ed3f61432f None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:04.103734 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b2d4-bb71-4446-b793-50ed3f61432f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:04.104081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b2d4-bb71-4446-b793-50ed3f61432f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:04.105471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b2d4-bb71-4446-b793-50ed3f61432f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:04.117331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 533/1074] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:04.124034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcf689-4f3c-4839-bd9e-e9c98252d085 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:04.211662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:04.230988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcf689-4f3c-4839-bd9e-e9c98252d085 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:04.265717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0dff-b537-43b3-a05c-43af1df06f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:04.266383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0dff-b537-43b3-a05c-43af1df06f46 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:04.266662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0dff-b537-43b3-a05c-43af1df06f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:04.266931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0dff-b537-43b3-a05c-43af1df06f46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:04.275258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f0dff-b537-43b3-a05c-43af1df06f46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:04.276699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f0dff-b537-43b3-a05c-43af1df06f46 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-078f0dff-b537-43b3-a05c-43af1df06f46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:46:04.289303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:04.291069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:04.292800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:46:04.292800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:46:04.292800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:46:04.292800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:46:04.292800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:46:04.292800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:46:04.292800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:46:04.292800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:04.292800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 542/1075] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:04.298018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b2d4-bb71-4446-b793-50ed3f61432f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:04.409727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b2d4-bb71-4446-b793-50ed3f61432f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:04.453959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3c592-d93b-4093-be23-9851aae68edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:04.455483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3c592-d93b-4093-be23-9851aae68edb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:04.455955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3c592-d93b-4093-be23-9851aae68edb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:04.456430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3c592-d93b-4093-be23-9851aae68edb None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:04.457856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3c592-d93b-4093-be23-9851aae68edb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:04.458394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3c592-d93b-4093-be23-9851aae68edb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:04.461070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3c592-d93b-4093-be23-9851aae68edb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:04.477369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 534/1076] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:04.483571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0dff-b537-43b3-a05c-43af1df06f46 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:04.601093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0dff-b537-43b3-a05c-43af1df06f46 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:04.637493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d859-cf12-4724-a2e7-1bdbfc350534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:04.638168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d859-cf12-4724-a2e7-1bdbfc350534 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:04.638440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d859-cf12-4724-a2e7-1bdbfc350534 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:04.638720 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d859-cf12-4724-a2e7-1bdbfc350534 None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/eea60163008a4bea95d130a5809fc50d/roles/8785ea09bd024e0ebc5d1b165022df20` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:04.640913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d859-cf12-4724-a2e7-1bdbfc350534 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=eea60163008a4bea95d130a5809fc50d, role_id=8785ea09bd024e0ebc5d1b165022df20)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:04.643032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d859-cf12-4724-a2e7-1bdbfc350534 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:04.705692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:04.711193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 543/1077] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:46:04 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/eea60163008a4bea95d130a5809fc50d/roles/8785ea09bd024e0ebc5d1b165022df20 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:46:05.379600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ade16a-3feb-4401-89b4-e96fead84d1c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:05.380275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ade16a-3feb-4401-89b4-e96fead84d1c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:05.380275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ade16a-3feb-4401-89b4-e96fead84d1c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:05.381538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 535/1078] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:05.387105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257c554-4ac8-458c-9dbd-8a3700fd7154 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:05.387398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257c554-4ac8-458c-9dbd-8a3700fd7154 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:05.387679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257c554-4ac8-458c-9dbd-8a3700fd7154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:05.407650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1257c554-4ac8-458c-9dbd-8a3700fd7154 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:05.409598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1257c554-4ac8-458c-9dbd-8a3700fd7154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:05.490137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 544/1079] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:05.513157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ade16a-3feb-4401-89b4-e96fead84d1c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:05.546056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:05.636642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ade16a-3feb-4401-89b4-e96fead84d1c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:05.676657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ebe9a-2389-4d4c-9dcc-2a492e1df138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:05.677515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ebe9a-2389-4d4c-9dcc-2a492e1df138 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:05.677802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ebe9a-2389-4d4c-9dcc-2a492e1df138 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:05.678079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ebe9a-2389-4d4c-9dcc-2a492e1df138 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:05.690467 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ebe9a-2389-4d4c-9dcc-2a492e1df138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-455ebe9a-2389-4d4c-9dcc-2a492e1df138 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:05.695509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:05.696513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:05.697409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 536/1080] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:05.703191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257c554-4ac8-458c-9dbd-8a3700fd7154 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:05.820330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257c554-4ac8-458c-9dbd-8a3700fd7154 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:05.860745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:05.867884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02bf77-c795-49aa-a307-e9485e9a9c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:05.868542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02bf77-c795-49aa-a307-e9485e9a9c11 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:05.870250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02bf77-c795-49aa-a307-e9485e9a9c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:05.870250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02bf77-c795-49aa-a307-e9485e9a9c11 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:05.870250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02bf77-c795-49aa-a307-e9485e9a9c11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:05.870250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02bf77-c795-49aa-a307-e9485e9a9c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:05.871746 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02bf77-c795-49aa-a307-e9485e9a9c11 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:05.881880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 545/1081] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:05.888077 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ebe9a-2389-4d4c-9dcc-2a492e1df138 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:06.026316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:06.041037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ebe9a-2389-4d4c-9dcc-2a492e1df138 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:06.086464 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c05b1-311e-4851-b2d9-e11192aeada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:06.087275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c05b1-311e-4851-b2d9-e11192aeada4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:06.087724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c05b1-311e-4851-b2d9-e11192aeada4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:06.088016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c05b1-311e-4851-b2d9-e11192aeada4 None admin] PATH_INFO: `/v3/users/ec0e69d914de4805aefa0a4b95147dcc` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:06.089542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c05b1-311e-4851-b2d9-e11192aeada4 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e69d914de4805aefa0a4b95147dcc)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:06.091121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c05b1-311e-4851-b2d9-e11192aeada4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:06.092979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 537/1082] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:05 2022] GET /identity/v3/users/ec0e69d914de4805aefa0a4b95147dcc => generated 285 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:06.100736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02bf77-c795-49aa-a307-e9485e9a9c11 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:06.219311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02bf77-c795-49aa-a307-e9485e9a9c11 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:06.259016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a27e6b-d5fa-4962-8147-c525981082cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:06.259682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a27e6b-d5fa-4962-8147-c525981082cc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:06.259962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a27e6b-d5fa-4962-8147-c525981082cc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:06.260239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a27e6b-d5fa-4962-8147-c525981082cc None admin] PATH_INFO: `/v3/projects/e5ebf1abdb5142c5b621885875bc9527` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:06.261532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a27e6b-d5fa-4962-8147-c525981082cc None admin] RBAC: Authorizing `identity:get_project(project_id=e5ebf1abdb5142c5b621885875bc9527)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:06.262989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a27e6b-d5fa-4962-8147-c525981082cc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:06.264708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 546/1083] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:06 2022] GET /identity/v3/projects/e5ebf1abdb5142c5b621885875bc9527 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:06.271167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c05b1-311e-4851-b2d9-e11192aeada4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:06.385918 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c05b1-311e-4851-b2d9-e11192aeada4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:06.425720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fbb52-d65c-4f2f-8185-b4d46e24736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:06.426665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fbb52-d65c-4f2f-8185-b4d46e24736c None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:06.427024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fbb52-d65c-4f2f-8185-b4d46e24736c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:06.427219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fbb52-d65c-4f2f-8185-b4d46e24736c None admin] PATH_INFO: `/v3/projects/e5ebf1abdb5142c5b621885875bc9527/users/ec0e69d914de4805aefa0a4b95147dcc/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:06.429325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fbb52-d65c-4f2f-8185-b4d46e24736c None admin] RBAC: Authorizing `identity:create_grant(project_id=e5ebf1abdb5142c5b621885875bc9527, user_id=ec0e69d914de4805aefa0a4b95147dcc, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:06.430779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fbb52-d65c-4f2f-8185-b4d46e24736c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:06.510054 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 538/1084] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:46:06 2022] PUT /identity/v3/projects/e5ebf1abdb5142c5b621885875bc9527/users/ec0e69d914de4805aefa0a4b95147dcc/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:46:06.809449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47352dd-38e8-42fd-885a-84b64a089a09 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:06.809994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47352dd-38e8-42fd-885a-84b64a089a09 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:06.809994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47352dd-38e8-42fd-885a-84b64a089a09 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:06.811301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 547/1085] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:06.817689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928c49-c37b-49e7-995b-972301849e5a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:06.818167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928c49-c37b-49e7-995b-972301849e5a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:06.818540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928c49-c37b-49e7-995b-972301849e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:06.838653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e9928c49-c37b-49e7-995b-972301849e5a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:06.839898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e9928c49-c37b-49e7-995b-972301849e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:06.857047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:06.935183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 539/1086] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:06.958520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47352dd-38e8-42fd-885a-84b64a089a09 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:07.024285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:07.067710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47352dd-38e8-42fd-885a-84b64a089a09 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:07.101911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf19333-df89-483c-b6a1-44cf1fa8bd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:07.102760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf19333-df89-483c-b6a1-44cf1fa8bd95 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:07.102860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf19333-df89-483c-b6a1-44cf1fa8bd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:07.103060 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf19333-df89-483c-b6a1-44cf1fa8bd95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:07.114064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf19333-df89-483c-b6a1-44cf1fa8bd95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-9bf19333-df89-483c-b6a1-44cf1fa8bd95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:07.118834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:07.119921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:07.120778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 548/1087] 10.222.0.55 () {56 vars in 1120 bytes} [Mon Jul 25 22:46:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:46:07.126192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9928c49-c37b-49e7-995b-972301849e5a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:07.241325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9928c49-c37b-49e7-995b-972301849e5a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:07.280489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992ed8-10a2-496f-a961-e80aff47e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:07.281153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992ed8-10a2-496f-a961-e80aff47e62d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:07.281443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992ed8-10a2-496f-a961-e80aff47e62d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:07.281723 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992ed8-10a2-496f-a961-e80aff47e62d None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:07.282449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a992ed8-10a2-496f-a961-e80aff47e62d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:07.282760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a992ed8-10a2-496f-a961-e80aff47e62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:07.284706 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a992ed8-10a2-496f-a961-e80aff47e62d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:07.293671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 540/1088] 10.222.0.55 () {56 vars in 1115 bytes} [Mon Jul 25 22:46:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:07.300166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf19333-df89-483c-b6a1-44cf1fa8bd95 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:07.434058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf19333-df89-483c-b6a1-44cf1fa8bd95 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:07.455321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:07.470251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197dda0-bcdf-4915-b3cb-ebc2a0c5625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:07.471255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197dda0-bcdf-4915-b3cb-ebc2a0c5625b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:07.471255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197dda0-bcdf-4915-b3cb-ebc2a0c5625b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:07.471662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197dda0-bcdf-4915-b3cb-ebc2a0c5625b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:07.482680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197dda0-bcdf-4915-b3cb-ebc2a0c5625b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:07.484151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197dda0-bcdf-4915-b3cb-ebc2a0c5625b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-e197dda0-bcdf-4915-b3cb-ebc2a0c5625b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:46:07.499821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:07.500787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:07.502713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:46:07.502713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:46:07.502713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:07.502713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:07.502713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 549/1089] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:07.507982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992ed8-10a2-496f-a961-e80aff47e62d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:07.521862 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:07.617202 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992ed8-10a2-496f-a961-e80aff47e62d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:07.664208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58753ff-3d9c-44a8-87d6-0914d74ccd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:07.664860 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58753ff-3d9c-44a8-87d6-0914d74ccd54 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:07.665197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58753ff-3d9c-44a8-87d6-0914d74ccd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:07.665479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58753ff-3d9c-44a8-87d6-0914d74ccd54 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:07.666234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58753ff-3d9c-44a8-87d6-0914d74ccd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:07.666557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58753ff-3d9c-44a8-87d6-0914d74ccd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:07.668184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58753ff-3d9c-44a8-87d6-0914d74ccd54 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:07.684829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 541/1090] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:07.690921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197dda0-bcdf-4915-b3cb-ebc2a0c5625b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:07.794232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197dda0-bcdf-4915-b3cb-ebc2a0c5625b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:07.829247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c2cb7-88b1-4c9e-b09b-29a61ce334b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:07.829934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c2cb7-88b1-4c9e-b09b-29a61ce334b0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:07.830418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c2cb7-88b1-4c9e-b09b-29a61ce334b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:07.830781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c2cb7-88b1-4c9e-b09b-29a61ce334b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:07.838573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c2cb7-88b1-4c9e-b09b-29a61ce334b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:07.840112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c2cb7-88b1-4c9e-b09b-29a61ce334b0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-751c2cb7-88b1-4c9e-b09b-29a61ce334b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:46:07.854048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:07.855061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:07.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 550/1091] 10.222.0.55 () {56 vars in 1093 bytes} [Mon Jul 25 22:46:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:07.862813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58753ff-3d9c-44a8-87d6-0914d74ccd54 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:07.930122 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:07.964296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58753ff-3d9c-44a8-87d6-0914d74ccd54 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:08.002229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bd3a4-75e6-4f36-9fdf-cc24f214fd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:08.002970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd3a4-75e6-4f36-9fdf-cc24f214fd1e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.003348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd3a4-75e6-4f36-9fdf-cc24f214fd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.003755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd3a4-75e6-4f36-9fdf-cc24f214fd1e None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.004709 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bd3a4-75e6-4f36-9fdf-cc24f214fd1e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:08.005185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bd3a4-75e6-4f36-9fdf-cc24f214fd1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:08.006764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bd3a4-75e6-4f36-9fdf-cc24f214fd1e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:08.025641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 542/1092] 10.222.0.55 () {56 vars in 1133 bytes} [Mon Jul 25 22:46:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:08.032895 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c2cb7-88b1-4c9e-b09b-29a61ce334b0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:08.067401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:08.152462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c2cb7-88b1-4c9e-b09b-29a61ce334b0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:08.188059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9274796-d0e4-4464-afef-ea953579657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:08.188681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274796-d0e4-4464-afef-ea953579657e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.197329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274796-d0e4-4464-afef-ea953579657e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.197329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274796-d0e4-4464-afef-ea953579657e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.266791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9274796-d0e4-4464-afef-ea953579657e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:08.269545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9274796-d0e4-4464-afef-ea953579657e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:08.302272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:08.384826 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 551/1093] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:46:08.390664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bd3a4-75e6-4f36-9fdf-cc24f214fd1e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:08.516101 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bd3a4-75e6-4f36-9fdf-cc24f214fd1e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:08.548849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:08.558638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058ad69-4d29-490e-b8e1-8c5541946f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:08.559326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058ad69-4d29-490e-b8e1-8c5541946f0e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.559605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058ad69-4d29-490e-b8e1-8c5541946f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.559875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058ad69-4d29-490e-b8e1-8c5541946f0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.572945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058ad69-4d29-490e-b8e1-8c5541946f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:08.574457 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058ad69-4d29-490e-b8e1-8c5541946f0e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f058ad69-4d29-490e-b8e1-8c5541946f0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:46:08.601024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:08.602059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:08.602949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:46:08.602949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:46:08.602949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:08.602949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:08.602949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 543/1094] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:46:08.607462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e6e57-8f51-4811-8be8-4d53cc637f24 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.607743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e6e57-8f51-4811-8be8-4d53cc637f24 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.608016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e6e57-8f51-4811-8be8-4d53cc637f24 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.608390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058ad69-4d29-490e-b8e1-8c5541946f0e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:08.609404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 552/1095] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:08.615059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab8ae6-e97f-4246-96d5-e18378a6aa41 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.615345 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab8ae6-e97f-4246-96d5-e18378a6aa41 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.615621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab8ae6-e97f-4246-96d5-e18378a6aa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.634720 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-16ab8ae6-e97f-4246-96d5-e18378a6aa41 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:08.635964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-16ab8ae6-e97f-4246-96d5-e18378a6aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:08.711874 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 553/1096] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:46:08.732704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058ad69-4d29-490e-b8e1-8c5541946f0e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:08.738899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab8ae6-e97f-4246-96d5-e18378a6aa41 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:08.769713 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c5797-e3c4-44ec-84bc-3ba845fde218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:08.770356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c5797-e3c4-44ec-84bc-3ba845fde218 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.770632 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c5797-e3c4-44ec-84bc-3ba845fde218 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.770900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c5797-e3c4-44ec-84bc-3ba845fde218 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.771589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c5797-e3c4-44ec-84bc-3ba845fde218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:08.771891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c5797-e3c4-44ec-84bc-3ba845fde218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:08.773293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c5797-e3c4-44ec-84bc-3ba845fde218 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:08.791699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 544/1097] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:08.792937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c5797-e3c4-44ec-84bc-3ba845fde218 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:08.807420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:08.839595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:08.863676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab8ae6-e97f-4246-96d5-e18378a6aa41 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:08.904165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a75fec-74da-4ee1-b5b6-f9ea6a9b19f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:08.904810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75fec-74da-4ee1-b5b6-f9ea6a9b19f4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.905090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75fec-74da-4ee1-b5b6-f9ea6a9b19f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.905391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75fec-74da-4ee1-b5b6-f9ea6a9b19f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.911785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c5797-e3c4-44ec-84bc-3ba845fde218 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:08.917271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a75fec-74da-4ee1-b5b6-f9ea6a9b19f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-26a75fec-74da-4ee1-b5b6-f9ea6a9b19f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:08.922253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:08.923860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:08.924901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 554/1098] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:46:08.930242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a75fec-74da-4ee1-b5b6-f9ea6a9b19f4 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:08.961579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df639d5-ef14-40f2-bc48-55335d03ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:08.962287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df639d5-ef14-40f2-bc48-55335d03ca19 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.962594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df639d5-ef14-40f2-bc48-55335d03ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.962891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df639d5-ef14-40f2-bc48-55335d03ca19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.973380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df639d5-ef14-40f2-bc48-55335d03ca19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:08.975899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df639d5-ef14-40f2-bc48-55335d03ca19 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-5df639d5-ef14-40f2-bc48-55335d03ca19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:46:08.989627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:08.991048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:08.992293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:46:08.992293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:46:08.992293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:46:08.992293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:46:08.992293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:46:08.992293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:46:08.992293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:46:08.992293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:08.992293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 545/1099] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:09.000527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df639d5-ef14-40f2-bc48-55335d03ca19 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:09.053276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a75fec-74da-4ee1-b5b6-f9ea6a9b19f4 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:09.077425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:09.090321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c1dd2-dcfd-44a1-a307-5bd3769d8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:09.090989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c1dd2-dcfd-44a1-a307-5bd3769d8851 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:09.091294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c1dd2-dcfd-44a1-a307-5bd3769d8851 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:09.091588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c1dd2-dcfd-44a1-a307-5bd3769d8851 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:09.092364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c1dd2-dcfd-44a1-a307-5bd3769d8851 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:09.092690 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c1dd2-dcfd-44a1-a307-5bd3769d8851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:09.094199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c1dd2-dcfd-44a1-a307-5bd3769d8851 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:09.103785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 555/1100] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:09.109753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c1dd2-dcfd-44a1-a307-5bd3769d8851 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:09.115729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:09.119813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df639d5-ef14-40f2-bc48-55335d03ca19 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:09.160556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71fa7-8e5c-4090-960b-d1e7a8e643c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:09.161223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71fa7-8e5c-4090-960b-d1e7a8e643c8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:09.161512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71fa7-8e5c-4090-960b-d1e7a8e643c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:09.161791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71fa7-8e5c-4090-960b-d1e7a8e643c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:09.162556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71fa7-8e5c-4090-960b-d1e7a8e643c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:09.162944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71fa7-8e5c-4090-960b-d1e7a8e643c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:09.164433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71fa7-8e5c-4090-960b-d1e7a8e643c8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:09.177447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 546/1101] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:46:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:09.183999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71fa7-8e5c-4090-960b-d1e7a8e643c8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:09.244122 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c1dd2-dcfd-44a1-a307-5bd3769d8851 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:09.288228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65458805-c00b-4846-a857-742d29c4a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:09.288885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458805-c00b-4846-a857-742d29c4a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:09.289198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458805-c00b-4846-a857-742d29c4a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:09.289475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458805-c00b-4846-a857-742d29c4a1f5 None admin] PATH_INFO: `/v3/users/ec0e69d914de4805aefa0a4b95147dcc` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:09.293557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65458805-c00b-4846-a857-742d29c4a1f5 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e69d914de4805aefa0a4b95147dcc)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:09.293557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65458805-c00b-4846-a857-742d29c4a1f5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:09.294226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 556/1102] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:09 2022] GET /identity/v3/users/ec0e69d914de4805aefa0a4b95147dcc => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:09.300645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65458805-c00b-4846-a857-742d29c4a1f5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:09.305429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71fa7-8e5c-4090-960b-d1e7a8e643c8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:09.348567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee81f03-cd13-4053-bc08-899272c39d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:09.349191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee81f03-cd13-4053-bc08-899272c39d3c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:09.349492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee81f03-cd13-4053-bc08-899272c39d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:09.349777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee81f03-cd13-4053-bc08-899272c39d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:09.350797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee81f03-cd13-4053-bc08-899272c39d3c None admin] RBAC: Adding query filter params (role.id=8785ea09bd024e0ebc5d1b165022df20, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=eea60163008a4bea95d130a5809fc50d) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:09.351263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee81f03-cd13-4053-bc08-899272c39d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:09.353041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee81f03-cd13-4053-bc08-899272c39d3c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:09.360185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 547/1103] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:46:09 2022] GET /identity/v3/role_assignments?user.id=eea60163008a4bea95d130a5809fc50d&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=8785ea09bd024e0ebc5d1b165022df20 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:09.363070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:09.420186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65458805-c00b-4846-a857-742d29c4a1f5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:09.460839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebce048-9b2c-4221-9e7a-4b318fd5fdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:09.461510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebce048-9b2c-4221-9e7a-4b318fd5fdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:09.461787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebce048-9b2c-4221-9e7a-4b318fd5fdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:09.462059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebce048-9b2c-4221-9e7a-4b318fd5fdc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:09.538795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebce048-9b2c-4221-9e7a-4b318fd5fdc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:09.540289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebce048-9b2c-4221-9e7a-4b318fd5fdc2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:09.603098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:09.664352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 557/1104] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:46:09.670770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee81f03-cd13-4053-bc08-899272c39d3c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:09.704267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:09.829727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee81f03-cd13-4053-bc08-899272c39d3c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:09.872564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb314cb6-fb39-43c1-9e21-5361241653ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:09.873278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb314cb6-fb39-43c1-9e21-5361241653ac None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:09.873555 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb314cb6-fb39-43c1-9e21-5361241653ac None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:09.873828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb314cb6-fb39-43c1-9e21-5361241653ac None admin] PATH_INFO: `/v3/projects/e5ebf1abdb5142c5b621885875bc9527` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:09.874998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb314cb6-fb39-43c1-9e21-5361241653ac None admin] RBAC: Authorizing `identity:get_project(project_id=e5ebf1abdb5142c5b621885875bc9527)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:09.876454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb314cb6-fb39-43c1-9e21-5361241653ac None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:09.878670 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 548/1105] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:09 2022] GET /identity/v3/projects/e5ebf1abdb5142c5b621885875bc9527 => generated 311 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:09.884824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebce048-9b2c-4221-9e7a-4b318fd5fdc2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:10.000619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebce048-9b2c-4221-9e7a-4b318fd5fdc2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:10.039483 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0bb77-764c-440b-8e44-14d5c42c52ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:10.040194 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0bb77-764c-440b-8e44-14d5c42c52ae None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:10.040849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0bb77-764c-440b-8e44-14d5c42c52ae None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:10.041098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0bb77-764c-440b-8e44-14d5c42c52ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:10.042750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0bb77-764c-440b-8e44-14d5c42c52ae None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=e5ebf1abdb5142c5b621885875bc9527, user.id=ec0e69d914de4805aefa0a4b95147dcc) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:10.043307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0bb77-764c-440b-8e44-14d5c42c52ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:10.046296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0bb77-764c-440b-8e44-14d5c42c52ae None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:10.056029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 558/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:46:09 2022] GET /identity/v3/role_assignments?user.id=ec0e69d914de4805aefa0a4b95147dcc&scope.project.id=e5ebf1abdb5142c5b621885875bc9527&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:12.150466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6b1fe-70f5-4f7c-9570-46b8e32e8c20 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:12.150989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6b1fe-70f5-4f7c-9570-46b8e32e8c20 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:12.150989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6b1fe-70f5-4f7c-9570-46b8e32e8c20 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:12.152288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 549/1107] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:12.158014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677f59b-922c-480a-bc3c-07aa28bb4910 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:12.158452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677f59b-922c-480a-bc3c-07aa28bb4910 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:12.158734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677f59b-922c-480a-bc3c-07aa28bb4910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:12.177308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2677f59b-922c-480a-bc3c-07aa28bb4910 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:12.178518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2677f59b-922c-480a-bc3c-07aa28bb4910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:12.190647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:12.252178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 559/1108] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:12.278277 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6b1fe-70f5-4f7c-9570-46b8e32e8c20 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:12.390147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:12.401803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6b1fe-70f5-4f7c-9570-46b8e32e8c20 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:12.438354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ff755-3e5a-46c9-9b3a-279d6033dd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:12.439094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff755-3e5a-46c9-9b3a-279d6033dd77 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:12.439381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff755-3e5a-46c9-9b3a-279d6033dd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:12.439645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff755-3e5a-46c9-9b3a-279d6033dd77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:12.441049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ff755-3e5a-46c9-9b3a-279d6033dd77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:12.442518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ff755-3e5a-46c9-9b3a-279d6033dd77 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:12.444114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 550/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:12.450024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677f59b-922c-480a-bc3c-07aa28bb4910 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:12.555143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677f59b-922c-480a-bc3c-07aa28bb4910 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:12.596680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efe8f2-433a-483b-baf2-05b72b81990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:12.597352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efe8f2-433a-483b-baf2-05b72b81990e None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:12.597638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efe8f2-433a-483b-baf2-05b72b81990e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:12.597914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efe8f2-433a-483b-baf2-05b72b81990e None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:12.598645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efe8f2-433a-483b-baf2-05b72b81990e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:12.600100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efe8f2-433a-483b-baf2-05b72b81990e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:12.697224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 560/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:46:12 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:46:14.804676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b830e-a905-419b-993e-0c456a1e916c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:14.805242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b830e-a905-419b-993e-0c456a1e916c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:14.805242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b830e-a905-419b-993e-0c456a1e916c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:14.806599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 551/1111] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:14.812016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63171b33-63bf-400c-9398-d6b5b496e565 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:14.812485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63171b33-63bf-400c-9398-d6b5b496e565 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:14.812580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63171b33-63bf-400c-9398-d6b5b496e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:14.819940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:14.832173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-63171b33-63bf-400c-9398-d6b5b496e565 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:14.833410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-63171b33-63bf-400c-9398-d6b5b496e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:14.902611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 561/1112] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:14.926915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b830e-a905-419b-993e-0c456a1e916c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:15.030297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b830e-a905-419b-993e-0c456a1e916c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:15.066661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834cf82-e90a-427e-a6d0-56d8c550f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:15.067210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834cf82-e90a-427e-a6d0-56d8c550f59d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.067493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834cf82-e90a-427e-a6d0-56d8c550f59d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.067772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834cf82-e90a-427e-a6d0-56d8c550f59d None admin] PATH_INFO: `/v3/roles/0cb8656b530647bea1bc161edf344c96` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.069278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834cf82-e90a-427e-a6d0-56d8c550f59d None admin] RBAC: Authorizing `identity:get_role(role_id=0cb8656b530647bea1bc161edf344c96)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:15.070652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834cf82-e90a-427e-a6d0-56d8c550f59d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:15.072013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 552/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:14 2022] GET /identity/v3/roles/0cb8656b530647bea1bc161edf344c96 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:15.077960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63171b33-63bf-400c-9398-d6b5b496e565 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:15.181241 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63171b33-63bf-400c-9398-d6b5b496e565 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:15.211434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:15.216511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae579a4-80a4-45d7-ba47-46e3e943ada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:15.217190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae579a4-80a4-45d7-ba47-46e3e943ada3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.217482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae579a4-80a4-45d7-ba47-46e3e943ada3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.217753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae579a4-80a4-45d7-ba47-46e3e943ada3 None admin] PATH_INFO: `/v3/users/b2e6f003443341ba9068dbb1a5cab170` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.233741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae579a4-80a4-45d7-ba47-46e3e943ada3 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e6f003443341ba9068dbb1a5cab170)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:15.235212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae579a4-80a4-45d7-ba47-46e3e943ada3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:15.237542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 562/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:15 2022] GET /identity/v3/users/b2e6f003443341ba9068dbb1a5cab170 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:15.244278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834cf82-e90a-427e-a6d0-56d8c550f59d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:15.273520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:15.351576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834cf82-e90a-427e-a6d0-56d8c550f59d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:15.388110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ab7f0-98c8-484f-9bb9-9c833b5060a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:15.388717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ab7f0-98c8-484f-9bb9-9c833b5060a5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.388999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ab7f0-98c8-484f-9bb9-9c833b5060a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.389300 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ab7f0-98c8-484f-9bb9-9c833b5060a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.461477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ab7f0-98c8-484f-9bb9-9c833b5060a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:15.462934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ab7f0-98c8-484f-9bb9-9c833b5060a5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:15.490684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:15.566584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 553/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:46:15.572782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae579a4-80a4-45d7-ba47-46e3e943ada3 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:15.681729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae579a4-80a4-45d7-ba47-46e3e943ada3 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:15.718204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb5ca8-46fa-46cf-9983-5aadcb8dc712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:15.718903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb5ca8-46fa-46cf-9983-5aadcb8dc712 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.719185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb5ca8-46fa-46cf-9983-5aadcb8dc712 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.719462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb5ca8-46fa-46cf-9983-5aadcb8dc712 None admin] PATH_INFO: `/v3/projects/e5ebf1abdb5142c5b621885875bc9527` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.721470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb5ca8-46fa-46cf-9983-5aadcb8dc712 None admin] RBAC: Authorizing `identity:get_project(project_id=e5ebf1abdb5142c5b621885875bc9527)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:15.722922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb5ca8-46fa-46cf-9983-5aadcb8dc712 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:15.724717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 563/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:15 2022] GET /identity/v3/projects/e5ebf1abdb5142c5b621885875bc9527 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:15.731062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ab7f0-98c8-484f-9bb9-9c833b5060a5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:15.834944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ab7f0-98c8-484f-9bb9-9c833b5060a5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:15.867610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:15.876397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd3bde-da50-42fb-b045-f20b312f56ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:15.877581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd3bde-da50-42fb-b045-f20b312f56ad None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.887762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd3bde-da50-42fb-b045-f20b312f56ad None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.887762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd3bde-da50-42fb-b045-f20b312f56ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.887762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd3bde-da50-42fb-b045-f20b312f56ad None admin] RBAC: Adding query filter params (role.id=0cb8656b530647bea1bc161edf344c96, scope.project.id=e5ebf1abdb5142c5b621885875bc9527, user.id=b2e6f003443341ba9068dbb1a5cab170) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:15.887762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd3bde-da50-42fb-b045-f20b312f56ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:15.887762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd3bde-da50-42fb-b045-f20b312f56ad None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:15.888187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 554/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:46:15 2022] GET /identity/v3/role_assignments?user.id=b2e6f003443341ba9068dbb1a5cab170&scope.project.id=e5ebf1abdb5142c5b621885875bc9527&role.id=0cb8656b530647bea1bc161edf344c96 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:17.926789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1dedf-aafc-4814-a748-b062369d4c49 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:17.927321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1dedf-aafc-4814-a748-b062369d4c49 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:17.927321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1dedf-aafc-4814-a748-b062369d4c49 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:17.928744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 564/1118] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:17.934485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb22a8-2b43-4073-803b-9702dd0f9efb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:17.934913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb22a8-2b43-4073-803b-9702dd0f9efb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:17.935346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb22a8-2b43-4073-803b-9702dd0f9efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:17.963206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-43cb22a8-2b43-4073-803b-9702dd0f9efb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:17.964411 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-43cb22a8-2b43-4073-803b-9702dd0f9efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:18.052127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 555/1119] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:18.075644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1dedf-aafc-4814-a748-b062369d4c49 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:18.139346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:18.185954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1dedf-aafc-4814-a748-b062369d4c49 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:18.224347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600f1fd-6272-410d-bc6e-30950851fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:18.224995 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600f1fd-6272-410d-bc6e-30950851fe3c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:18.225303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600f1fd-6272-410d-bc6e-30950851fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:18.225575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600f1fd-6272-410d-bc6e-30950851fe3c None admin] PATH_INFO: `/v3/roles/0cb8656b530647bea1bc161edf344c96` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:18.227079 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600f1fd-6272-410d-bc6e-30950851fe3c None admin] RBAC: Authorizing `identity:get_role(role_id=0cb8656b530647bea1bc161edf344c96)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:18.228483 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600f1fd-6272-410d-bc6e-30950851fe3c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:18.229915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 565/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:18 2022] GET /identity/v3/roles/0cb8656b530647bea1bc161edf344c96 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:18.237148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb22a8-2b43-4073-803b-9702dd0f9efb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:18.351554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb22a8-2b43-4073-803b-9702dd0f9efb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:18.373601 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:18.387915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cfc44-deae-4f3e-89dc-91652ba23ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:18.388575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cfc44-deae-4f3e-89dc-91652ba23ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:18.388859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cfc44-deae-4f3e-89dc-91652ba23ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:18.389157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cfc44-deae-4f3e-89dc-91652ba23ab7 None admin] PATH_INFO: `/v3/users/b2e6f003443341ba9068dbb1a5cab170` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:18.390418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cfc44-deae-4f3e-89dc-91652ba23ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e6f003443341ba9068dbb1a5cab170)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:18.391834 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cfc44-deae-4f3e-89dc-91652ba23ab7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:18.394036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 556/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:18 2022] GET /identity/v3/users/b2e6f003443341ba9068dbb1a5cab170 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:18.400128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600f1fd-6272-410d-bc6e-30950851fe3c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:18.506198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600f1fd-6272-410d-bc6e-30950851fe3c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:18.534636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:18.543676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce0b17-74ce-4575-ae3b-f75ec05785c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:18.547286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce0b17-74ce-4575-ae3b-f75ec05785c6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:18.547286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce0b17-74ce-4575-ae3b-f75ec05785c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:18.547286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce0b17-74ce-4575-ae3b-f75ec05785c6 None admin] PATH_INFO: `/v3/projects/e5ebf1abdb5142c5b621885875bc9527` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:18.547286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce0b17-74ce-4575-ae3b-f75ec05785c6 None admin] RBAC: Authorizing `identity:get_project(project_id=e5ebf1abdb5142c5b621885875bc9527)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:18.547623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce0b17-74ce-4575-ae3b-f75ec05785c6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:18.549476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 566/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:18 2022] GET /identity/v3/projects/e5ebf1abdb5142c5b621885875bc9527 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:18.556265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cfc44-deae-4f3e-89dc-91652ba23ab7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:18.669729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cfc44-deae-4f3e-89dc-91652ba23ab7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:18.708219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7526b4-028c-4948-9b88-d85c4be7878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:18.708897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7526b4-028c-4948-9b88-d85c4be7878a None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:18.709203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7526b4-028c-4948-9b88-d85c4be7878a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:18.709478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7526b4-028c-4948-9b88-d85c4be7878a None admin] PATH_INFO: `/v3/projects/e5ebf1abdb5142c5b621885875bc9527/users/b2e6f003443341ba9068dbb1a5cab170/roles/0cb8656b530647bea1bc161edf344c96` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:18.712073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7526b4-028c-4948-9b88-d85c4be7878a None admin] RBAC: Authorizing `identity:create_grant(project_id=e5ebf1abdb5142c5b621885875bc9527, user_id=b2e6f003443341ba9068dbb1a5cab170, role_id=0cb8656b530647bea1bc161edf344c96)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:18.713559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7526b4-028c-4948-9b88-d85c4be7878a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:18.869928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 557/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:46:18 2022] PUT /identity/v3/projects/e5ebf1abdb5142c5b621885875bc9527/users/b2e6f003443341ba9068dbb1a5cab170/roles/0cb8656b530647bea1bc161edf344c96 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:46:20.916682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bf0c-d9ad-4cd3-b5d0-3f409d68e5c6 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:20.917228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bf0c-d9ad-4cd3-b5d0-3f409d68e5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:20.917429 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bf0c-d9ad-4cd3-b5d0-3f409d68e5c6 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:20.918636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 567/1124] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:20.924689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48cb3-2550-45ae-8d7b-5e081b3a7f7a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:20.925104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48cb3-2550-45ae-8d7b-5e081b3a7f7a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:20.925284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48cb3-2550-45ae-8d7b-5e081b3a7f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:20.945501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ebd48cb3-2550-45ae-8d7b-5e081b3a7f7a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:20.946707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ebd48cb3-2550-45ae-8d7b-5e081b3a7f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:20.996768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:21.021587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 558/1125] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:21.045997 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bf0c-d9ad-4cd3-b5d0-3f409d68e5c6 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:21.187028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bf0c-d9ad-4cd3-b5d0-3f409d68e5c6 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:21.239113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3477b9-5c2d-4cc1-8aff-64ad5dcfb96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:21.240025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3477b9-5c2d-4cc1-8aff-64ad5dcfb96f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:21.240379 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3477b9-5c2d-4cc1-8aff-64ad5dcfb96f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:21.240655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3477b9-5c2d-4cc1-8aff-64ad5dcfb96f None admin] PATH_INFO: `/v3/roles/0cb8656b530647bea1bc161edf344c96` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:21.242170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3477b9-5c2d-4cc1-8aff-64ad5dcfb96f None admin] RBAC: Authorizing `identity:get_role(role_id=0cb8656b530647bea1bc161edf344c96)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:21.243543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3477b9-5c2d-4cc1-8aff-64ad5dcfb96f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:21.244914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 568/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:21 2022] GET /identity/v3/roles/0cb8656b530647bea1bc161edf344c96 => generated 223 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:21.251607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48cb3-2550-45ae-8d7b-5e081b3a7f7a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:21.394401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48cb3-2550-45ae-8d7b-5e081b3a7f7a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:21.431005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088a3d-8000-4f87-a431-390c5f1d1221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:21.431661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088a3d-8000-4f87-a431-390c5f1d1221 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:21.431945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088a3d-8000-4f87-a431-390c5f1d1221 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:21.432225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088a3d-8000-4f87-a431-390c5f1d1221 None admin] PATH_INFO: `/v3/users/b2e6f003443341ba9068dbb1a5cab170` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:21.433443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97088a3d-8000-4f87-a431-390c5f1d1221 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e6f003443341ba9068dbb1a5cab170)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:21.434899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97088a3d-8000-4f87-a431-390c5f1d1221 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:21.436527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 559/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:21 2022] GET /identity/v3/users/b2e6f003443341ba9068dbb1a5cab170 => generated 286 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:21.443408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3477b9-5c2d-4cc1-8aff-64ad5dcfb96f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:21.525410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:21.567712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3477b9-5c2d-4cc1-8aff-64ad5dcfb96f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:21.612912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcab776-457e-41df-9a6d-48cf4d9f4596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:21.614010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcab776-457e-41df-9a6d-48cf4d9f4596 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:21.614502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcab776-457e-41df-9a6d-48cf4d9f4596 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:21.614998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcab776-457e-41df-9a6d-48cf4d9f4596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:21.725755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcab776-457e-41df-9a6d-48cf4d9f4596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:21.727632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcab776-457e-41df-9a6d-48cf4d9f4596 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:21.817314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:21.858503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 569/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:46:21.865382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088a3d-8000-4f87-a431-390c5f1d1221 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:21.915261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:21.972573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088a3d-8000-4f87-a431-390c5f1d1221 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:22.008641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd217795-7b88-443d-bb8b-1268d75334c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:22.009235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217795-7b88-443d-bb8b-1268d75334c9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:22.009516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217795-7b88-443d-bb8b-1268d75334c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:22.009791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217795-7b88-443d-bb8b-1268d75334c9 None admin] PATH_INFO: `/v3/projects/e5ebf1abdb5142c5b621885875bc9527` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:22.010957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd217795-7b88-443d-bb8b-1268d75334c9 None admin] RBAC: Authorizing `identity:get_project(project_id=e5ebf1abdb5142c5b621885875bc9527)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:22.012399 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd217795-7b88-443d-bb8b-1268d75334c9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:22.014101 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 560/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:21 2022] GET /identity/v3/projects/e5ebf1abdb5142c5b621885875bc9527 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:22.022976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcab776-457e-41df-9a6d-48cf4d9f4596 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:22.127255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcab776-457e-41df-9a6d-48cf4d9f4596 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:22.163191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654c144-95a6-431a-a3f9-20827a77d46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:22.163819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654c144-95a6-431a-a3f9-20827a77d46e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:22.164102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654c144-95a6-431a-a3f9-20827a77d46e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:22.164378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654c144-95a6-431a-a3f9-20827a77d46e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:22.165205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654c144-95a6-431a-a3f9-20827a77d46e None admin] RBAC: Adding query filter params (role.id=0cb8656b530647bea1bc161edf344c96, scope.project.id=e5ebf1abdb5142c5b621885875bc9527, user.id=b2e6f003443341ba9068dbb1a5cab170) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:22.165524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654c144-95a6-431a-a3f9-20827a77d46e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:22.166966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654c144-95a6-431a-a3f9-20827a77d46e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:22.173790 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 570/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:46:22 2022] GET /identity/v3/role_assignments?user.id=b2e6f003443341ba9068dbb1a5cab170&scope.project.id=e5ebf1abdb5142c5b621885875bc9527&role.id=0cb8656b530647bea1bc161edf344c96 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:24.304744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65329-730e-42eb-8274-b03f3394f5f5 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:24.305346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65329-730e-42eb-8274-b03f3394f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:24.305346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65329-730e-42eb-8274-b03f3394f5f5 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:24.306765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 561/1131] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:46:24.312739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabd84-cf3c-4555-ac0c-d56e46cb52fe None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:24.313299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabd84-cf3c-4555-ac0c-d56e46cb52fe None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:24.313415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabd84-cf3c-4555-ac0c-d56e46cb52fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:24.336391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9dfabd84-cf3c-4555-ac0c-d56e46cb52fe None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:24.337638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9dfabd84-cf3c-4555-ac0c-d56e46cb52fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:24.360230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:24.411074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 571/1132] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:46:24.436055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa65329-730e-42eb-8274-b03f3394f5f5 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:24.551758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa65329-730e-42eb-8274-b03f3394f5f5 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:24.569591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:24.593743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff618166-8853-495e-9584-cfd83b35d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:24.599369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618166-8853-495e-9584-cfd83b35d7ee None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:24.599369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618166-8853-495e-9584-cfd83b35d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:24.599369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618166-8853-495e-9584-cfd83b35d7ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:24.599369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff618166-8853-495e-9584-cfd83b35d7ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:24.599369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff618166-8853-495e-9584-cfd83b35d7ee None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:24.600980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 562/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:24.607572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfabd84-cf3c-4555-ac0c-d56e46cb52fe None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:24.746969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfabd84-cf3c-4555-ac0c-d56e46cb52fe None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:24.786126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cd53c-0c73-4d4c-92c9-66dfdb243f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:24.786753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cd53c-0c73-4d4c-92c9-66dfdb243f30 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:24.787031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cd53c-0c73-4d4c-92c9-66dfdb243f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:24.787303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cd53c-0c73-4d4c-92c9-66dfdb243f30 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:24.787988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cd53c-0c73-4d4c-92c9-66dfdb243f30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:24.789446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cd53c-0c73-4d4c-92c9-66dfdb243f30 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:24.950267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 572/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:46:24 2022] POST /identity/v3/projects => generated 311 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:46:27.064116 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a324218-00ba-49e6-976e-27a03f5dfc61 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:27.065224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a324218-00ba-49e6-976e-27a03f5dfc61 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:27.065224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a324218-00ba-49e6-976e-27a03f5dfc61 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:27.066288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 563/1135] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:27.071516 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587afaaf-7da1-4c87-a2d2-b6aac0328fd9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:27.071978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587afaaf-7da1-4c87-a2d2-b6aac0328fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:27.072072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587afaaf-7da1-4c87-a2d2-b6aac0328fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:27.091109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-587afaaf-7da1-4c87-a2d2-b6aac0328fd9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:27.092321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-587afaaf-7da1-4c87-a2d2-b6aac0328fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:27.094392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:27.167113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 573/1136] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:27.209859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a324218-00ba-49e6-976e-27a03f5dfc61 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:27.350243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a324218-00ba-49e6-976e-27a03f5dfc61 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:27.388757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6f7f5-add5-476e-8b16-3889effee5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:27.389420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6f7f5-add5-476e-8b16-3889effee5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:27.389699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6f7f5-add5-476e-8b16-3889effee5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:27.389973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6f7f5-add5-476e-8b16-3889effee5a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:27.391127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6f7f5-add5-476e-8b16-3889effee5a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:27.393454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6f7f5-add5-476e-8b16-3889effee5a4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:27.395059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 564/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:27.400802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587afaaf-7da1-4c87-a2d2-b6aac0328fd9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:27.503822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587afaaf-7da1-4c87-a2d2-b6aac0328fd9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:27.538487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e75fd-800d-4f35-a0b0-eff47baf6574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:27.539097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e75fd-800d-4f35-a0b0-eff47baf6574 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:27.539375 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e75fd-800d-4f35-a0b0-eff47baf6574 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:27.539647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e75fd-800d-4f35-a0b0-eff47baf6574 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:27.540326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e75fd-800d-4f35-a0b0-eff47baf6574 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:27.541798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e75fd-800d-4f35-a0b0-eff47baf6574 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:27.552353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:27.636487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 574/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:46:27 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:46:29.723612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f80a8-15df-4212-93cd-7542ae641076 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:29.724168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f80a8-15df-4212-93cd-7542ae641076 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:29.724168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f80a8-15df-4212-93cd-7542ae641076 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:29.725541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 565/1139] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:29.730841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561db121-cd64-4804-8ac4-79ce405903d4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:29.731288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561db121-cd64-4804-8ac4-79ce405903d4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:29.731389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561db121-cd64-4804-8ac4-79ce405903d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:29.750435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-561db121-cd64-4804-8ac4-79ce405903d4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:29.752381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-561db121-cd64-4804-8ac4-79ce405903d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:29.821408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 575/1140] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:29.850218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f80a8-15df-4212-93cd-7542ae641076 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:29.907574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:29.967487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f80a8-15df-4212-93cd-7542ae641076 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:30.008862 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc60c5b-21e3-4377-a168-4cf0a6931d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:30.009459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc60c5b-21e3-4377-a168-4cf0a6931d5c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:30.009745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc60c5b-21e3-4377-a168-4cf0a6931d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:30.010022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc60c5b-21e3-4377-a168-4cf0a6931d5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:30.020853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc60c5b-21e3-4377-a168-4cf0a6931d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1dc60c5b-21e3-4377-a168-4cf0a6931d5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:30.025909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:30.027153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:30.028426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 566/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:30.034055 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561db121-cd64-4804-8ac4-79ce405903d4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:30.140433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561db121-cd64-4804-8ac4-79ce405903d4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:30.165510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:30.176991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86272029-d6ed-4f70-8efe-dfcbfa9565c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:30.177648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272029-d6ed-4f70-8efe-dfcbfa9565c6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:30.177928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272029-d6ed-4f70-8efe-dfcbfa9565c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:30.178199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272029-d6ed-4f70-8efe-dfcbfa9565c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:30.178917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86272029-d6ed-4f70-8efe-dfcbfa9565c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:30.179218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86272029-d6ed-4f70-8efe-dfcbfa9565c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:30.180616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86272029-d6ed-4f70-8efe-dfcbfa9565c6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:30.188783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 576/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:30.195271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc60c5b-21e3-4377-a168-4cf0a6931d5c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:30.299960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc60c5b-21e3-4377-a168-4cf0a6931d5c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:30.310960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:30.335722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70df520-efd9-4d3b-a6ab-bcb0639c1185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:30.336358 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df520-efd9-4d3b-a6ab-bcb0639c1185 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:30.336633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df520-efd9-4d3b-a6ab-bcb0639c1185 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:30.336903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df520-efd9-4d3b-a6ab-bcb0639c1185 None admin] PATH_INFO: `/v3/users/7e6ae83dbe724517883c53ee286b036a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:30.350975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70df520-efd9-4d3b-a6ab-bcb0639c1185 None admin] RBAC: Authorizing `identity:get_user(user_id=7e6ae83dbe724517883c53ee286b036a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:30.352425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70df520-efd9-4d3b-a6ab-bcb0639c1185 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:30.354085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 567/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:30 2022] GET /identity/v3/users/7e6ae83dbe724517883c53ee286b036a => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:30.359916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86272029-d6ed-4f70-8efe-dfcbfa9565c6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:30.459050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86272029-d6ed-4f70-8efe-dfcbfa9565c6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:30.491940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884282f-32d9-4813-bc65-de86ddd0d345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:30.492557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884282f-32d9-4813-bc65-de86ddd0d345 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:30.492834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884282f-32d9-4813-bc65-de86ddd0d345 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:30.493107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884282f-32d9-4813-bc65-de86ddd0d345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:30.549378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:30.565981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884282f-32d9-4813-bc65-de86ddd0d345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:30.567366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884282f-32d9-4813-bc65-de86ddd0d345 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:30.672390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 577/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:46:30.678714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70df520-efd9-4d3b-a6ab-bcb0639c1185 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:30.786643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70df520-efd9-4d3b-a6ab-bcb0639c1185 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:30.823987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c48bc-399e-4d28-868d-cd45998e2a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:30.824542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c48bc-399e-4d28-868d-cd45998e2a8d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:30.824820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c48bc-399e-4d28-868d-cd45998e2a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:30.825093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c48bc-399e-4d28-868d-cd45998e2a8d None admin] PATH_INFO: `/v3/projects/5f5c7978ac7c4e4a848326ef153d21c7` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:30.826267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c48bc-399e-4d28-868d-cd45998e2a8d None admin] RBAC: Authorizing `identity:get_project(project_id=5f5c7978ac7c4e4a848326ef153d21c7)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:30.827693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c48bc-399e-4d28-868d-cd45998e2a8d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:30.830156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 568/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:30 2022] GET /identity/v3/projects/5f5c7978ac7c4e4a848326ef153d21c7 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:30.836354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884282f-32d9-4813-bc65-de86ddd0d345 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:30.920553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:30.935350 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884282f-32d9-4813-bc65-de86ddd0d345 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:30.970719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373aa56-0dcf-4262-9563-0ce4c68b7909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:30.971342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373aa56-0dcf-4262-9563-0ce4c68b7909 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:30.971623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373aa56-0dcf-4262-9563-0ce4c68b7909 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:30.971899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373aa56-0dcf-4262-9563-0ce4c68b7909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:30.972690 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373aa56-0dcf-4262-9563-0ce4c68b7909 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=5f5c7978ac7c4e4a848326ef153d21c7, user.id=7e6ae83dbe724517883c53ee286b036a) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:30.973001 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373aa56-0dcf-4262-9563-0ce4c68b7909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:30.974471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373aa56-0dcf-4262-9563-0ce4c68b7909 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:30.980213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 578/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:46:30 2022] GET /identity/v3/role_assignments?user.id=7e6ae83dbe724517883c53ee286b036a&scope.project.id=5f5c7978ac7c4e4a848326ef153d21c7&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:32.998961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74ebb4-ebb1-4ef8-8eff-6773a20bf865 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:32.999523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74ebb4-ebb1-4ef8-8eff-6773a20bf865 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:32.999523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74ebb4-ebb1-4ef8-8eff-6773a20bf865 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:33.001458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 569/1147] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:33.007607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999365-7248-4c00-b4b2-6ded6e970d4d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:33.008074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999365-7248-4c00-b4b2-6ded6e970d4d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:33.008177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999365-7248-4c00-b4b2-6ded6e970d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:33.027069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e2999365-7248-4c00-b4b2-6ded6e970d4d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:33.028262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e2999365-7248-4c00-b4b2-6ded6e970d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:33.096947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 579/1148] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:46:33.120711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74ebb4-ebb1-4ef8-8eff-6773a20bf865 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:33.158645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:33.228707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74ebb4-ebb1-4ef8-8eff-6773a20bf865 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:33.263372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c8c4d-a1e3-46b1-ad24-f08074c925f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:33.263998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c8c4d-a1e3-46b1-ad24-f08074c925f2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:33.264280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c8c4d-a1e3-46b1-ad24-f08074c925f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:33.264556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c8c4d-a1e3-46b1-ad24-f08074c925f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:33.274955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c8c4d-a1e3-46b1-ad24-f08074c925f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-8d7c8c4d-a1e3-46b1-ad24-f08074c925f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:33.279772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:33.280849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:33.282456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 570/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:33.288789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2999365-7248-4c00-b4b2-6ded6e970d4d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:33.377213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:33.395442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2999365-7248-4c00-b4b2-6ded6e970d4d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:33.432371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb53fe6-f82e-47d9-9bea-12ca97a8407c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:33.433390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb53fe6-f82e-47d9-9bea-12ca97a8407c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:33.433667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb53fe6-f82e-47d9-9bea-12ca97a8407c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:33.433933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb53fe6-f82e-47d9-9bea-12ca97a8407c None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:33.434639 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb53fe6-f82e-47d9-9bea-12ca97a8407c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:33.434937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb53fe6-f82e-47d9-9bea-12ca97a8407c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:33.436290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb53fe6-f82e-47d9-9bea-12ca97a8407c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:33.444347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 580/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:33.450272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c8c4d-a1e3-46b1-ad24-f08074c925f2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:33.543251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:33.548834 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c8c4d-a1e3-46b1-ad24-f08074c925f2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:33.583349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4080fc-6b76-435c-8af1-fdc82c2ab32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:33.583972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4080fc-6b76-435c-8af1-fdc82c2ab32f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:33.584249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4080fc-6b76-435c-8af1-fdc82c2ab32f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:33.584520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4080fc-6b76-435c-8af1-fdc82c2ab32f None admin] PATH_INFO: `/v3/users/7e6ae83dbe724517883c53ee286b036a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:33.585687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4080fc-6b76-435c-8af1-fdc82c2ab32f None admin] RBAC: Authorizing `identity:get_user(user_id=7e6ae83dbe724517883c53ee286b036a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:33.587150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4080fc-6b76-435c-8af1-fdc82c2ab32f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:33.588736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 571/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:33 2022] GET /identity/v3/users/7e6ae83dbe724517883c53ee286b036a => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:33.595255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb53fe6-f82e-47d9-9bea-12ca97a8407c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:33.695181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb53fe6-f82e-47d9-9bea-12ca97a8407c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:33.739596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7a93d-5702-4ae2-a344-0bb5992fe994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:33.740249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a93d-5702-4ae2-a344-0bb5992fe994 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:33.740525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a93d-5702-4ae2-a344-0bb5992fe994 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:33.740802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a93d-5702-4ae2-a344-0bb5992fe994 None admin] PATH_INFO: `/v3/projects/5f5c7978ac7c4e4a848326ef153d21c7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:33.741992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7a93d-5702-4ae2-a344-0bb5992fe994 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5c7978ac7c4e4a848326ef153d21c7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:33.743416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7a93d-5702-4ae2-a344-0bb5992fe994 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:33.745096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 581/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:33 2022] GET /identity/v3/projects/5f5c7978ac7c4e4a848326ef153d21c7 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:33.751993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4080fc-6b76-435c-8af1-fdc82c2ab32f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:33.867804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4080fc-6b76-435c-8af1-fdc82c2ab32f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:33.903871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35457b61-3675-40d7-9c64-012f228985be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:33.904567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457b61-3675-40d7-9c64-012f228985be None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:33.904851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457b61-3675-40d7-9c64-012f228985be None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:33.905158 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457b61-3675-40d7-9c64-012f228985be None admin] PATH_INFO: `/v3/projects/5f5c7978ac7c4e4a848326ef153d21c7/users/7e6ae83dbe724517883c53ee286b036a/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:33.907665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35457b61-3675-40d7-9c64-012f228985be None admin] RBAC: Authorizing `identity:create_grant(project_id=5f5c7978ac7c4e4a848326ef153d21c7, user_id=7e6ae83dbe724517883c53ee286b036a, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:33.909111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35457b61-3675-40d7-9c64-012f228985be None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:33.977609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 572/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:46:33 2022] PUT /identity/v3/projects/5f5c7978ac7c4e4a848326ef153d21c7/users/7e6ae83dbe724517883c53ee286b036a/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:46:35.977596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfc51a-37d1-4553-a6c9-89f37ff6f802 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:35.978119 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfc51a-37d1-4553-a6c9-89f37ff6f802 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:35.978119 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfc51a-37d1-4553-a6c9-89f37ff6f802 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:35.979515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 582/1154] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:35.985475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc903326-95d1-4392-a6d5-f6eadbe30b64 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:35.985903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc903326-95d1-4392-a6d5-f6eadbe30b64 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:35.986036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc903326-95d1-4392-a6d5-f6eadbe30b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:36.005059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-dc903326-95d1-4392-a6d5-f6eadbe30b64 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:36.006302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-dc903326-95d1-4392-a6d5-f6eadbe30b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:36.024250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:36.074725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 573/1155] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:36.099096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfc51a-37d1-4553-a6c9-89f37ff6f802 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:36.113857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:36.210942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfc51a-37d1-4553-a6c9-89f37ff6f802 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:36.247327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd34f2c-141d-4ec8-9f02-22d634889bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:36.247970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd34f2c-141d-4ec8-9f02-22d634889bfc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:36.248252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd34f2c-141d-4ec8-9f02-22d634889bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:36.248533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd34f2c-141d-4ec8-9f02-22d634889bfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:36.259360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd34f2c-141d-4ec8-9f02-22d634889bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-8cd34f2c-141d-4ec8-9f02-22d634889bfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:36.264239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:36.265462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:36.267528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 583/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:36.271891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc903326-95d1-4392-a6d5-f6eadbe30b64 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:36.375454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc903326-95d1-4392-a6d5-f6eadbe30b64 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:36.409992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7fb77-6d68-437b-9a03-353232899c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:36.410612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7fb77-6d68-437b-9a03-353232899c1c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:36.410902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7fb77-6d68-437b-9a03-353232899c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:36.411189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7fb77-6d68-437b-9a03-353232899c1c None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:36.411884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7fb77-6d68-437b-9a03-353232899c1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:36.412186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7fb77-6d68-437b-9a03-353232899c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:36.413605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7fb77-6d68-437b-9a03-353232899c1c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:36.421927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 574/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:36.428906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd34f2c-141d-4ec8-9f02-22d634889bfc None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:36.504617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:36.536695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd34f2c-141d-4ec8-9f02-22d634889bfc None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:36.580356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939595d-52a5-48a6-9d97-e0e6227fa0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:36.581022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939595d-52a5-48a6-9d97-e0e6227fa0cc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:36.581326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939595d-52a5-48a6-9d97-e0e6227fa0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:36.581598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939595d-52a5-48a6-9d97-e0e6227fa0cc None admin] PATH_INFO: `/v3/users/7e6ae83dbe724517883c53ee286b036a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:36.582831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939595d-52a5-48a6-9d97-e0e6227fa0cc None admin] RBAC: Authorizing `identity:get_user(user_id=7e6ae83dbe724517883c53ee286b036a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:36.586118 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939595d-52a5-48a6-9d97-e0e6227fa0cc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:36.587784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 584/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:36 2022] GET /identity/v3/users/7e6ae83dbe724517883c53ee286b036a => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:36.593816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7fb77-6d68-437b-9a03-353232899c1c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:36.614538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:36.703645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7fb77-6d68-437b-9a03-353232899c1c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:36.739054 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe76d-0f3c-495f-bff0-bafb6a5c7a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:36.739676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe76d-0f3c-495f-bff0-bafb6a5c7a06 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:36.739958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe76d-0f3c-495f-bff0-bafb6a5c7a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:36.740232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe76d-0f3c-495f-bff0-bafb6a5c7a06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:36.811200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbe76d-0f3c-495f-bff0-bafb6a5c7a06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:36.813197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbe76d-0f3c-495f-bff0-bafb6a5c7a06 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:36.830994 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:36.919905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 575/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:46:36.927326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939595d-52a5-48a6-9d97-e0e6227fa0cc None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:37.032583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939595d-52a5-48a6-9d97-e0e6227fa0cc None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:37.070370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8d167-c94c-48c2-9f7e-60651d780ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:37.071013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8d167-c94c-48c2-9f7e-60651d780ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:37.071297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8d167-c94c-48c2-9f7e-60651d780ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:37.071575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8d167-c94c-48c2-9f7e-60651d780ad9 None admin] PATH_INFO: `/v3/projects/5f5c7978ac7c4e4a848326ef153d21c7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:37.072745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8d167-c94c-48c2-9f7e-60651d780ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5c7978ac7c4e4a848326ef153d21c7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:37.074222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8d167-c94c-48c2-9f7e-60651d780ad9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:37.075911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 585/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:36 2022] GET /identity/v3/projects/5f5c7978ac7c4e4a848326ef153d21c7 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:37.083029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe76d-0f3c-495f-bff0-bafb6a5c7a06 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:37.189058 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe76d-0f3c-495f-bff0-bafb6a5c7a06 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:37.206949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:37.225759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a70100-df20-4076-927b-2daf1e837a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:37.228372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a70100-df20-4076-927b-2daf1e837a15 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:37.228372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a70100-df20-4076-927b-2daf1e837a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:37.228372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a70100-df20-4076-927b-2daf1e837a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:37.228372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a70100-df20-4076-927b-2daf1e837a15 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=5f5c7978ac7c4e4a848326ef153d21c7, user.id=7e6ae83dbe724517883c53ee286b036a) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:37.228372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a70100-df20-4076-927b-2daf1e837a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:37.229695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a70100-df20-4076-927b-2daf1e837a15 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:37.236206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 576/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:46:37 2022] GET /identity/v3/role_assignments?user.id=7e6ae83dbe724517883c53ee286b036a&scope.project.id=5f5c7978ac7c4e4a848326ef153d21c7&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:39.298028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b5ef0-eb97-489a-924e-03a8714aa18c None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:39.298535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b5ef0-eb97-489a-924e-03a8714aa18c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:39.298535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b5ef0-eb97-489a-924e-03a8714aa18c None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:39.299867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 586/1162] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:39.305342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e026cd-39f8-45c2-83ba-fe07404b7dd0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:39.305784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e026cd-39f8-45c2-83ba-fe07404b7dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:39.305872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e026cd-39f8-45c2-83ba-fe07404b7dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:39.325503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-18e026cd-39f8-45c2-83ba-fe07404b7dd0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:39.326185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-18e026cd-39f8-45c2-83ba-fe07404b7dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:39.396688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 577/1163] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:39.419570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b5ef0-eb97-489a-924e-03a8714aa18c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:39.429639 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:39.522597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b5ef0-eb97-489a-924e-03a8714aa18c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:39.558981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1152f-4dbb-4584-9fd8-e9f0bfc16afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:39.559512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1152f-4dbb-4584-9fd8-e9f0bfc16afa None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:39.559794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1152f-4dbb-4584-9fd8-e9f0bfc16afa None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:39.560069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1152f-4dbb-4584-9fd8-e9f0bfc16afa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:39.642041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1152f-4dbb-4584-9fd8-e9f0bfc16afa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:39.643501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1152f-4dbb-4584-9fd8-e9f0bfc16afa None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:39.651429 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:39.741317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 587/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:46:39.747640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e026cd-39f8-45c2-83ba-fe07404b7dd0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:39.845239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e026cd-39f8-45c2-83ba-fe07404b7dd0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:39.856302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:39.880076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225b296-bb71-4fec-bd29-59b6288b7d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:39.880717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225b296-bb71-4fec-bd29-59b6288b7d9d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:39.881003 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225b296-bb71-4fec-bd29-59b6288b7d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:39.881317 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225b296-bb71-4fec-bd29-59b6288b7d9d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:39.888063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225b296-bb71-4fec-bd29-59b6288b7d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:39.889612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225b296-bb71-4fec-bd29-59b6288b7d9d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-5225b296-bb71-4fec-bd29-59b6288b7d9d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:39.902249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:39.903347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:39.904315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 578/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Mon Jul 25 22:46:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:39.910279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1152f-4dbb-4584-9fd8-e9f0bfc16afa None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:40.007096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1152f-4dbb-4584-9fd8-e9f0bfc16afa None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:40.014323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:40.040344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3d5a-01cf-4f88-8da7-a4c2c8abfce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:40.040955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3d5a-01cf-4f88-8da7-a4c2c8abfce5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:40.041281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3d5a-01cf-4f88-8da7-a4c2c8abfce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:40.041552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3d5a-01cf-4f88-8da7-a4c2c8abfce5 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:40.042244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3d5a-01cf-4f88-8da7-a4c2c8abfce5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:40.042547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3d5a-01cf-4f88-8da7-a4c2c8abfce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:40.043935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3d5a-01cf-4f88-8da7-a4c2c8abfce5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:40.052641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 588/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Mon Jul 25 22:46:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:42.091892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113e035-0115-41ec-acbc-642945af5fc7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:42.092440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113e035-0115-41ec-acbc-642945af5fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:42.092440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113e035-0115-41ec-acbc-642945af5fc7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:42.094493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 579/1167] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:42.100377 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e922a5-2fd9-4479-9231-2eccb9b83cdd None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:42.100940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e922a5-2fd9-4479-9231-2eccb9b83cdd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:42.100940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e922a5-2fd9-4479-9231-2eccb9b83cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:42.120776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b7e922a5-2fd9-4479-9231-2eccb9b83cdd None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:42.121983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b7e922a5-2fd9-4479-9231-2eccb9b83cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:42.195769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 589/1168] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:42.219267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113e035-0115-41ec-acbc-642945af5fc7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:42.327151 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113e035-0115-41ec-acbc-642945af5fc7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:42.365362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3f53c-89ec-4e5e-b321-75d7d8061b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:42.365991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3f53c-89ec-4e5e-b321-75d7d8061b7f None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:42.366268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3f53c-89ec-4e5e-b321-75d7d8061b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:42.366540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3f53c-89ec-4e5e-b321-75d7d8061b7f None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:42.367264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3f53c-89ec-4e5e-b321-75d7d8061b7f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:42.368644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3f53c-89ec-4e5e-b321-75d7d8061b7f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:42.475958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 580/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Mon Jul 25 22:46:42 2022] POST /identity/v3/domains => generated 267 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:46:44.545065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af58b-fd6a-4881-9ea9-00fb7b235808 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:44.545626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af58b-fd6a-4881-9ea9-00fb7b235808 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:44.545715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af58b-fd6a-4881-9ea9-00fb7b235808 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:44.547708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 590/1170] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:44.553478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be05f-dfff-45b5-9ddb-5caaa1ce7b13 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:44.554205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be05f-dfff-45b5-9ddb-5caaa1ce7b13 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:44.554205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be05f-dfff-45b5-9ddb-5caaa1ce7b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:44.573230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5f7be05f-dfff-45b5-9ddb-5caaa1ce7b13 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:44.574467 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5f7be05f-dfff-45b5-9ddb-5caaa1ce7b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:44.609998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:44.656397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 581/1171] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:44.680972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065af58b-fd6a-4881-9ea9-00fb7b235808 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:44.779611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:44.784058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065af58b-fd6a-4881-9ea9-00fb7b235808 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:44.818748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6173832-1786-4c91-a81d-2be34875fc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:44.819311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6173832-1786-4c91-a81d-2be34875fc50 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:44.819591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6173832-1786-4c91-a81d-2be34875fc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:44.819864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6173832-1786-4c91-a81d-2be34875fc50 None admin] PATH_INFO: `/v3/domains/814fde868a8a416ca0c3eecec805796f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:44.831607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6173832-1786-4c91-a81d-2be34875fc50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=814fde868a8a416ca0c3eecec805796f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:44.833365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6173832-1786-4c91-a81d-2be34875fc50 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:44.835518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 591/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Mon Jul 25 22:46:44 2022] GET /identity/v3/domains/814fde868a8a416ca0c3eecec805796f => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:44.841496 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be05f-dfff-45b5-9ddb-5caaa1ce7b13 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:44.964565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be05f-dfff-45b5-9ddb-5caaa1ce7b13 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:44.999386 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74149e57-68db-4c50-a4c8-c67b884799d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:45.000085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149e57-68db-4c50-a4c8-c67b884799d4 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:45.000362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149e57-68db-4c50-a4c8-c67b884799d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:45.000639 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149e57-68db-4c50-a4c8-c67b884799d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:45.001364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74149e57-68db-4c50-a4c8-c67b884799d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:45.002842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74149e57-68db-4c50-a4c8-c67b884799d4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:45.100603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 582/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:46:44 2022] POST /identity/v3/projects => generated 361 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:46:47.210887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3261-8dc5-44d6-a267-2a672af0f4b0 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:47.211403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3261-8dc5-44d6-a267-2a672af0f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:47.211403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3261-8dc5-44d6-a267-2a672af0f4b0 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:47.212736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 592/1174] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:46:47.218064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588949ef-675b-4dbf-a6b6-5448d723e6b9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:47.219027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588949ef-675b-4dbf-a6b6-5448d723e6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:47.219265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588949ef-675b-4dbf-a6b6-5448d723e6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:47.237288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-588949ef-675b-4dbf-a6b6-5448d723e6b9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:47.238494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-588949ef-675b-4dbf-a6b6-5448d723e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:47.246068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:47.307609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 583/1175] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:47.332816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e3261-8dc5-44d6-a267-2a672af0f4b0 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:47.432834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e3261-8dc5-44d6-a267-2a672af0f4b0 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:47.467540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58f497-5fec-40be-bf49-c8b79069b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:47.468089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f497-5fec-40be-bf49-c8b79069b502 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:47.468530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f497-5fec-40be-bf49-c8b79069b502 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:47.468807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f497-5fec-40be-bf49-c8b79069b502 None admin] PATH_INFO: `/v3/domains/814fde868a8a416ca0c3eecec805796f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:47.470101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58f497-5fec-40be-bf49-c8b79069b502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=814fde868a8a416ca0c3eecec805796f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:47.471522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58f497-5fec-40be-bf49-c8b79069b502 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:47.473170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 593/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Mon Jul 25 22:46:47 2022] GET /identity/v3/domains/814fde868a8a416ca0c3eecec805796f => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:47.478978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588949ef-675b-4dbf-a6b6-5448d723e6b9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:47.579822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588949ef-675b-4dbf-a6b6-5448d723e6b9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:47.613553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3de323-3e1d-41ac-8d45-6ca28e5c248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:47.614167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3de323-3e1d-41ac-8d45-6ca28e5c248a None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:47.614442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3de323-3e1d-41ac-8d45-6ca28e5c248a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:47.614713 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3de323-3e1d-41ac-8d45-6ca28e5c248a None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:47.615400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3de323-3e1d-41ac-8d45-6ca28e5c248a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:47.616829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3de323-3e1d-41ac-8d45-6ca28e5c248a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:47.684981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:47.691594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 584/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:46:47 2022] POST /identity/v3/users => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:46:49.773950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48fd77-516e-4674-94b2-51b94c58509f None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:49.774488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48fd77-516e-4674-94b2-51b94c58509f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:49.774488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48fd77-516e-4674-94b2-51b94c58509f None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:49.775849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 594/1178] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:49.781565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025a0ff-5480-49a8-9d21-e2c0f59f6eeb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:49.782058 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025a0ff-5480-49a8-9d21-e2c0f59f6eeb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:49.782161 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025a0ff-5480-49a8-9d21-e2c0f59f6eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:49.801153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5025a0ff-5480-49a8-9d21-e2c0f59f6eeb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:49.802364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5025a0ff-5480-49a8-9d21-e2c0f59f6eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:49.873952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 585/1179] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:46:49.897817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48fd77-516e-4674-94b2-51b94c58509f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:49.934033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:50.012522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48fd77-516e-4674-94b2-51b94c58509f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:50.050551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f9f91-a8f5-4868-818f-9a5278444f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:50.051128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f9f91-a8f5-4868-818f-9a5278444f6d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.051404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f9f91-a8f5-4868-818f-9a5278444f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.051674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f9f91-a8f5-4868-818f-9a5278444f6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.063268 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f9f91-a8f5-4868-818f-9a5278444f6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-517f9f91-a8f5-4868-818f-9a5278444f6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:50.068112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:50.069254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:50.070416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 595/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:50.075588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025a0ff-5480-49a8-9d21-e2c0f59f6eeb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:50.176158 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025a0ff-5480-49a8-9d21-e2c0f59f6eeb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:50.202356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:50.211414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d43c4-3937-477d-a097-530bae4118f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:50.212032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d43c4-3937-477d-a097-530bae4118f0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.212375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d43c4-3937-477d-a097-530bae4118f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.216900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d43c4-3937-477d-a097-530bae4118f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.216900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d43c4-3937-477d-a097-530bae4118f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:50.216900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d43c4-3937-477d-a097-530bae4118f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:50.216900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d43c4-3937-477d-a097-530bae4118f0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:50.224086 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 586/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:50.229922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f9f91-a8f5-4868-818f-9a5278444f6d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:50.319882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:50.332465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f9f91-a8f5-4868-818f-9a5278444f6d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:50.366412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa71c-69c2-4aa6-a020-b2e819f3578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:50.367037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa71c-69c2-4aa6-a020-b2e819f3578e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.367315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa71c-69c2-4aa6-a020-b2e819f3578e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.367588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa71c-69c2-4aa6-a020-b2e819f3578e None admin] PATH_INFO: `/v3/users/9b951f98547a47dbb1ea6f0d8772bdcf` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.381849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa71c-69c2-4aa6-a020-b2e819f3578e None admin] RBAC: Authorizing `identity:get_user(user_id=9b951f98547a47dbb1ea6f0d8772bdcf)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:50.383255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa71c-69c2-4aa6-a020-b2e819f3578e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:50.384945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 596/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:50 2022] GET /identity/v3/users/9b951f98547a47dbb1ea6f0d8772bdcf => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:50.391568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d43c4-3937-477d-a097-530bae4118f0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:50.490715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d43c4-3937-477d-a097-530bae4118f0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:50.525275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4ead0-4ad8-44e5-9ee4-d93173c419c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:50.525904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4ead0-4ad8-44e5-9ee4-d93173c419c2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.526190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4ead0-4ad8-44e5-9ee4-d93173c419c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.526471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4ead0-4ad8-44e5-9ee4-d93173c419c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.584392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:50.594165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4ead0-4ad8-44e5-9ee4-d93173c419c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:50.595631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4ead0-4ad8-44e5-9ee4-d93173c419c2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:50.695034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 587/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:46:50.700975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa71c-69c2-4aa6-a020-b2e819f3578e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:50.798715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa71c-69c2-4aa6-a020-b2e819f3578e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:50.833314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631274bb-95ba-45f5-82a5-03c47eefb1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:50.833953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631274bb-95ba-45f5-82a5-03c47eefb1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.834232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631274bb-95ba-45f5-82a5-03c47eefb1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.834547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631274bb-95ba-45f5-82a5-03c47eefb1e8 None admin] PATH_INFO: `/v3/projects/d46e474f56d64efa8357cabc2e8443b3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.835774 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631274bb-95ba-45f5-82a5-03c47eefb1e8 None admin] RBAC: Authorizing `identity:get_project(project_id=d46e474f56d64efa8357cabc2e8443b3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:50.837248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631274bb-95ba-45f5-82a5-03c47eefb1e8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:50.838972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 597/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:50 2022] GET /identity/v3/projects/d46e474f56d64efa8357cabc2e8443b3 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:50.846156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4ead0-4ad8-44e5-9ee4-d93173c419c2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:50.937423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:50.947008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4ead0-4ad8-44e5-9ee4-d93173c419c2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:50.983293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e32e38-d1e2-4a4d-a990-5b3cc944dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:50.983942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e32e38-d1e2-4a4d-a990-5b3cc944dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.984218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e32e38-d1e2-4a4d-a990-5b3cc944dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.984493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e32e38-d1e2-4a4d-a990-5b3cc944dbb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.985312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e32e38-d1e2-4a4d-a990-5b3cc944dbb3 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=d46e474f56d64efa8357cabc2e8443b3, user.id=9b951f98547a47dbb1ea6f0d8772bdcf) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:50.985624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e32e38-d1e2-4a4d-a990-5b3cc944dbb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:50.987063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e32e38-d1e2-4a4d-a990-5b3cc944dbb3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:50.992632 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 588/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:46:50 2022] GET /identity/v3/role_assignments?user.id=9b951f98547a47dbb1ea6f0d8772bdcf&scope.project.id=d46e474f56d64efa8357cabc2e8443b3&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:53.002378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a98d12-3257-4a7c-bf3d-5a651948fa48 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.002967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a98d12-3257-4a7c-bf3d-5a651948fa48 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.002967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a98d12-3257-4a7c-bf3d-5a651948fa48 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.004289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 598/1186] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:53.009608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e360ae1-90fa-4145-864c-9b0fa02a5bf1 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.010061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e360ae1-90fa-4145-864c-9b0fa02a5bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.010160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e360ae1-90fa-4145-864c-9b0fa02a5bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.029007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8e360ae1-90fa-4145-864c-9b0fa02a5bf1 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:53.030223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8e360ae1-90fa-4145-864c-9b0fa02a5bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:53.101100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 589/1187] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:53.123784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a98d12-3257-4a7c-bf3d-5a651948fa48 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.139544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:53.226252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a98d12-3257-4a7c-bf3d-5a651948fa48 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.262565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897257e-305f-46e2-86d0-7b7a5c447698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.263220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897257e-305f-46e2-86d0-7b7a5c447698 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.263495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897257e-305f-46e2-86d0-7b7a5c447698 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.263765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897257e-305f-46e2-86d0-7b7a5c447698 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.275902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897257e-305f-46e2-86d0-7b7a5c447698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f897257e-305f-46e2-86d0-7b7a5c447698 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:53.281560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:53.282798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:46:53.283976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 599/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:53.289411 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e360ae1-90fa-4145-864c-9b0fa02a5bf1 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.373379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:53.389343 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e360ae1-90fa-4145-864c-9b0fa02a5bf1 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.423088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09ce34-698b-4277-b67a-37b9bdc35f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.423694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09ce34-698b-4277-b67a-37b9bdc35f0c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.423974 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09ce34-698b-4277-b67a-37b9bdc35f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.424249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09ce34-698b-4277-b67a-37b9bdc35f0c None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.425239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09ce34-698b-4277-b67a-37b9bdc35f0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:53.425547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09ce34-698b-4277-b67a-37b9bdc35f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.426920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09ce34-698b-4277-b67a-37b9bdc35f0c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.434716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 590/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:53.441500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897257e-305f-46e2-86d0-7b7a5c447698 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.514698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:53.539347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897257e-305f-46e2-86d0-7b7a5c447698 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.574064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9a0fb-e7fb-447d-851a-dd09a7642437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.574698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a0fb-e7fb-447d-851a-dd09a7642437 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.574975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a0fb-e7fb-447d-851a-dd09a7642437 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.575251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a0fb-e7fb-447d-851a-dd09a7642437 None admin] PATH_INFO: `/v3/users/9b951f98547a47dbb1ea6f0d8772bdcf` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.576410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9a0fb-e7fb-447d-851a-dd09a7642437 None admin] RBAC: Authorizing `identity:get_user(user_id=9b951f98547a47dbb1ea6f0d8772bdcf)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.578682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9a0fb-e7fb-447d-851a-dd09a7642437 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.580289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 600/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:53 2022] GET /identity/v3/users/9b951f98547a47dbb1ea6f0d8772bdcf => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:53.586335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09ce34-698b-4277-b67a-37b9bdc35f0c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.687654 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09ce34-698b-4277-b67a-37b9bdc35f0c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.722240 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6af30d-d762-4ca4-b88c-bd2cee32567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.722874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6af30d-d762-4ca4-b88c-bd2cee32567d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.723153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6af30d-d762-4ca4-b88c-bd2cee32567d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.723425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6af30d-d762-4ca4-b88c-bd2cee32567d None admin] PATH_INFO: `/v3/projects/d46e474f56d64efa8357cabc2e8443b3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.724564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6af30d-d762-4ca4-b88c-bd2cee32567d None admin] RBAC: Authorizing `identity:get_project(project_id=d46e474f56d64efa8357cabc2e8443b3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.726030 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6af30d-d762-4ca4-b88c-bd2cee32567d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.727690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 591/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:53 2022] GET /identity/v3/projects/d46e474f56d64efa8357cabc2e8443b3 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:53.734242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9a0fb-e7fb-447d-851a-dd09a7642437 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.835392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9a0fb-e7fb-447d-851a-dd09a7642437 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.869031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6abc9f-5a38-45f8-9aee-ee0767823985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.869718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6abc9f-5a38-45f8-9aee-ee0767823985 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.869997 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6abc9f-5a38-45f8-9aee-ee0767823985 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.870269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6abc9f-5a38-45f8-9aee-ee0767823985 None admin] PATH_INFO: `/v3/projects/d46e474f56d64efa8357cabc2e8443b3/users/9b951f98547a47dbb1ea6f0d8772bdcf/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.872185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6abc9f-5a38-45f8-9aee-ee0767823985 None admin] RBAC: Authorizing `identity:create_grant(project_id=d46e474f56d64efa8357cabc2e8443b3, user_id=9b951f98547a47dbb1ea6f0d8772bdcf, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.873667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6abc9f-5a38-45f8-9aee-ee0767823985 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.953313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 601/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:46:53 2022] PUT /identity/v3/projects/d46e474f56d64efa8357cabc2e8443b3/users/9b951f98547a47dbb1ea6f0d8772bdcf/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:46:55.964332 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8ba2f-697d-4ad3-bca4-44d4997ed1e5 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:55.964882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8ba2f-697d-4ad3-bca4-44d4997ed1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:55.964882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8ba2f-697d-4ad3-bca4-44d4997ed1e5 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:55.966346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 592/1193] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:55.972136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e46c-46d4-407e-b483-2aa41edf489b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:55.972668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e46c-46d4-407e-b483-2aa41edf489b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:55.972668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e46c-46d4-407e-b483-2aa41edf489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:55.979048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:55.990972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-26b8e46c-46d4-407e-b483-2aa41edf489b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:55.992275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-26b8e46c-46d4-407e-b483-2aa41edf489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:56.060171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 602/1194] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:46:56.083606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8ba2f-697d-4ad3-bca4-44d4997ed1e5 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:56.101679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:56.190848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8ba2f-697d-4ad3-bca4-44d4997ed1e5 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:56.225796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f984b2-cff8-4b11-aaf8-a8dba07d6364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:56.226425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f984b2-cff8-4b11-aaf8-a8dba07d6364 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.226706 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f984b2-cff8-4b11-aaf8-a8dba07d6364 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.226982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f984b2-cff8-4b11-aaf8-a8dba07d6364 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.238336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f984b2-cff8-4b11-aaf8-a8dba07d6364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f2f984b2-cff8-4b11-aaf8-a8dba07d6364 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:56.243222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:56.244312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:46:56.245237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 593/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:46:56.251144 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e46c-46d4-407e-b483-2aa41edf489b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:56.350064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e46c-46d4-407e-b483-2aa41edf489b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:56.380094 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:56.384941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd301f4-ccd1-43b7-b3ac-01361376fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:56.385596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd301f4-ccd1-43b7-b3ac-01361376fa4f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.385871 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd301f4-ccd1-43b7-b3ac-01361376fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.394870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd301f4-ccd1-43b7-b3ac-01361376fa4f None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.394870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd301f4-ccd1-43b7-b3ac-01361376fa4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:56.394870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd301f4-ccd1-43b7-b3ac-01361376fa4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:56.394870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd301f4-ccd1-43b7-b3ac-01361376fa4f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:56.397705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 603/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:56.403643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f984b2-cff8-4b11-aaf8-a8dba07d6364 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:56.481770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:56.508322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f984b2-cff8-4b11-aaf8-a8dba07d6364 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:56.541865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dfc09-2019-4ee0-9f8c-4f45d66e5d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:56.542485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dfc09-2019-4ee0-9f8c-4f45d66e5d3f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.542762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dfc09-2019-4ee0-9f8c-4f45d66e5d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.543034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dfc09-2019-4ee0-9f8c-4f45d66e5d3f None admin] PATH_INFO: `/v3/users/9b951f98547a47dbb1ea6f0d8772bdcf` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.544259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dfc09-2019-4ee0-9f8c-4f45d66e5d3f None admin] RBAC: Authorizing `identity:get_user(user_id=9b951f98547a47dbb1ea6f0d8772bdcf)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:56.545839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dfc09-2019-4ee0-9f8c-4f45d66e5d3f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:56.547982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 594/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:56 2022] GET /identity/v3/users/9b951f98547a47dbb1ea6f0d8772bdcf => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:56.555348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd301f4-ccd1-43b7-b3ac-01361376fa4f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:56.659869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd301f4-ccd1-43b7-b3ac-01361376fa4f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:56.694380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc646d-370a-4b5e-9830-5ce462ee33c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:56.695005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc646d-370a-4b5e-9830-5ce462ee33c3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.695284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc646d-370a-4b5e-9830-5ce462ee33c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.695553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc646d-370a-4b5e-9830-5ce462ee33c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.754953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:56.761990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc646d-370a-4b5e-9830-5ce462ee33c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:56.763449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc646d-370a-4b5e-9830-5ce462ee33c3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:56.862627 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 604/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:46:56.868596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dfc09-2019-4ee0-9f8c-4f45d66e5d3f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:56.970662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dfc09-2019-4ee0-9f8c-4f45d66e5d3f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:57.004818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8548cf-afea-40ff-aa1b-86a86ea89119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:57.005534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8548cf-afea-40ff-aa1b-86a86ea89119 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.005759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8548cf-afea-40ff-aa1b-86a86ea89119 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.006029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8548cf-afea-40ff-aa1b-86a86ea89119 None admin] PATH_INFO: `/v3/projects/d46e474f56d64efa8357cabc2e8443b3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.007180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8548cf-afea-40ff-aa1b-86a86ea89119 None admin] RBAC: Authorizing `identity:get_project(project_id=d46e474f56d64efa8357cabc2e8443b3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:57.008605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8548cf-afea-40ff-aa1b-86a86ea89119 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:57.010312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 595/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Mon Jul 25 22:46:56 2022] GET /identity/v3/projects/d46e474f56d64efa8357cabc2e8443b3 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:57.017916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc646d-370a-4b5e-9830-5ce462ee33c3 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:57.113916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:57.120622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc646d-370a-4b5e-9830-5ce462ee33c3 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:57.154713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b1e46-10cb-4456-b1ad-a7332cb9b1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:57.155935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1e46-10cb-4456-b1ad-a7332cb9b1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.156216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1e46-10cb-4456-b1ad-a7332cb9b1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.156493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1e46-10cb-4456-b1ad-a7332cb9b1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.157309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b1e46-10cb-4456-b1ad-a7332cb9b1f5 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=d46e474f56d64efa8357cabc2e8443b3, user.id=9b951f98547a47dbb1ea6f0d8772bdcf) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:57.157619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b1e46-10cb-4456-b1ad-a7332cb9b1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:57.159051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b1e46-10cb-4456-b1ad-a7332cb9b1f5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:57.164794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 605/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:46:57 2022] GET /identity/v3/role_assignments?user.id=9b951f98547a47dbb1ea6f0d8772bdcf&scope.project.id=d46e474f56d64efa8357cabc2e8443b3&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:07.000592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:07.162221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=21 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:10.170042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940ac28-bcf0-4f45-ae83-06ea220f6b3f None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.170593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940ac28-bcf0-4f45-ae83-06ea220f6b3f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.170593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940ac28-bcf0-4f45-ae83-06ea220f6b3f None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.172137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 596/1201] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:10.177450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b80d32-9982-4451-8f85-aafa2cbd4748 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.177865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b80d32-9982-4451-8f85-aafa2cbd4748 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.177991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b80d32-9982-4451-8f85-aafa2cbd4748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.196579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e3b80d32-9982-4451-8f85-aafa2cbd4748 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:10.198368 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e3b80d32-9982-4451-8f85-aafa2cbd4748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:10.267278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 606/1202] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:10.292623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940ac28-bcf0-4f45-ae83-06ea220f6b3f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:10.399189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940ac28-bcf0-4f45-ae83-06ea220f6b3f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.436501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb3ae8-0814-4fa2-b72b-32307196cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.437063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb3ae8-0814-4fa2-b72b-32307196cbeb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.437378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb3ae8-0814-4fa2-b72b-32307196cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.437656 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb3ae8-0814-4fa2-b72b-32307196cbeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.448319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb3ae8-0814-4fa2-b72b-32307196cbeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.449775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb3ae8-0814-4fa2-b72b-32307196cbeb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-4eeb3ae8-0814-4fa2-b72b-32307196cbeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:10.463895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:10.467220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:10.468333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:10.468333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:10.468333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:10.468333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:10.468333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 597/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:10.471358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b80d32-9982-4451-8f85-aafa2cbd4748 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:10.572245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b80d32-9982-4451-8f85-aafa2cbd4748 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.602314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:10.609374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ff47b-3403-465e-8677-52e0ef528e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.610074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ff47b-3403-465e-8677-52e0ef528e33 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.610399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ff47b-3403-465e-8677-52e0ef528e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.610802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ff47b-3403-465e-8677-52e0ef528e33 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.611430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ff47b-3403-465e-8677-52e0ef528e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:10.611739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ff47b-3403-465e-8677-52e0ef528e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.613191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ff47b-3403-465e-8677-52e0ef528e33 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.625646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 607/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:10.632145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb3ae8-0814-4fa2-b72b-32307196cbeb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:10.690425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:10.736965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb3ae8-0814-4fa2-b72b-32307196cbeb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.771851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442b811-a2ba-4773-8ea1-06bfd64c888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.772428 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442b811-a2ba-4773-8ea1-06bfd64c888b None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.772705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442b811-a2ba-4773-8ea1-06bfd64c888b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.772976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442b811-a2ba-4773-8ea1-06bfd64c888b None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.773678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442b811-a2ba-4773-8ea1-06bfd64c888b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.775099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442b811-a2ba-4773-8ea1-06bfd64c888b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.852436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 598/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Mon Jul 25 22:48:10 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:12.919719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639e05f-1621-4ddc-bcdb-122e5dc078ff None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:12.920261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639e05f-1621-4ddc-bcdb-122e5dc078ff None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:12.920261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639e05f-1621-4ddc-bcdb-122e5dc078ff None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:12.921940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 608/1206] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:12.929038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98b650-4091-48e7-a1fc-18a4cfc059a5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:12.930291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98b650-4091-48e7-a1fc-18a4cfc059a5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:12.930291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98b650-4091-48e7-a1fc-18a4cfc059a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:12.949226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2d98b650-4091-48e7-a1fc-18a4cfc059a5 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:12.953485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2d98b650-4091-48e7-a1fc-18a4cfc059a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:13.018225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 599/1207] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:13.041917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639e05f-1621-4ddc-bcdb-122e5dc078ff None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.147961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639e05f-1621-4ddc-bcdb-122e5dc078ff None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.183198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50c13c-c982-408d-8468-0de5b2a2127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.183837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c13c-c982-408d-8468-0de5b2a2127d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.184119 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c13c-c982-408d-8468-0de5b2a2127d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.184393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c13c-c982-408d-8468-0de5b2a2127d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.194852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50c13c-c982-408d-8468-0de5b2a2127d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ee50c13c-c982-408d-8468-0de5b2a2127d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:13.199822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:13.201054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:13.202000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 609/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:13.207240 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98b650-4091-48e7-a1fc-18a4cfc059a5 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.247996 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.311705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98b650-4091-48e7-a1fc-18a4cfc059a5 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.347628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e37d0-caae-47bd-b3a0-22fe44cc11a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.348270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e37d0-caae-47bd-b3a0-22fe44cc11a3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.348551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e37d0-caae-47bd-b3a0-22fe44cc11a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.348828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e37d0-caae-47bd-b3a0-22fe44cc11a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.349588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e37d0-caae-47bd-b3a0-22fe44cc11a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:13.349897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e37d0-caae-47bd-b3a0-22fe44cc11a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.351285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e37d0-caae-47bd-b3a0-22fe44cc11a3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.359876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 600/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:13.365758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50c13c-c982-408d-8468-0de5b2a2127d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.416264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.468152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50c13c-c982-408d-8468-0de5b2a2127d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.502966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c1b9c-5e40-46d3-904b-1162bc81aac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.503603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c1b9c-5e40-46d3-904b-1162bc81aac4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.503926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c1b9c-5e40-46d3-904b-1162bc81aac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.504218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c1b9c-5e40-46d3-904b-1162bc81aac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.514920 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c1b9c-5e40-46d3-904b-1162bc81aac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.516519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c1b9c-5e40-46d3-904b-1162bc81aac4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-718c1b9c-5e40-46d3-904b-1162bc81aac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:13.531431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:13.532597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:13.533951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:13.533951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:13.533951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:13.533951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:13.533951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 610/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:13.538522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e37d0-caae-47bd-b3a0-22fe44cc11a3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.643558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.646542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e37d0-caae-47bd-b3a0-22fe44cc11a3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.681764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14465365-a00e-4349-9fee-18da552bdf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.682525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14465365-a00e-4349-9fee-18da552bdf37 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.682922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14465365-a00e-4349-9fee-18da552bdf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.683201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14465365-a00e-4349-9fee-18da552bdf37 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.683924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14465365-a00e-4349-9fee-18da552bdf37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:13.684222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14465365-a00e-4349-9fee-18da552bdf37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.685653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14465365-a00e-4349-9fee-18da552bdf37 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.697454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 601/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:13.703627 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c1b9c-5e40-46d3-904b-1162bc81aac4 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.806691 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c1b9c-5e40-46d3-904b-1162bc81aac4 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.808332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.841335 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0aa220-68fe-4bd3-87e7-e773e1cc0804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.841980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0aa220-68fe-4bd3-87e7-e773e1cc0804 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.842267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0aa220-68fe-4bd3-87e7-e773e1cc0804 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.842587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0aa220-68fe-4bd3-87e7-e773e1cc0804 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.850610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0aa220-68fe-4bd3-87e7-e773e1cc0804 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.852232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0aa220-68fe-4bd3-87e7-e773e1cc0804 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ea0aa220-68fe-4bd3-87e7-e773e1cc0804 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:13.864378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:13.865508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:13.867028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 611/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:13.871575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14465365-a00e-4349-9fee-18da552bdf37 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.975227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14465365-a00e-4349-9fee-18da552bdf37 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.009467 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9895-1d04-4d98-a63f-a16370b9b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.010075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9895-1d04-4d98-a63f-a16370b9b2ec None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.010352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9895-1d04-4d98-a63f-a16370b9b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.010619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9895-1d04-4d98-a63f-a16370b9b2ec None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.012367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d9895-1d04-4d98-a63f-a16370b9b2ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:14.012673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d9895-1d04-4d98-a63f-a16370b9b2ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.014268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d9895-1d04-4d98-a63f-a16370b9b2ec None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.032894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 602/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:14.038666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0aa220-68fe-4bd3-87e7-e773e1cc0804 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.143224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0aa220-68fe-4bd3-87e7-e773e1cc0804 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.177056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f906cb8-2308-4c92-a73d-4beca9363aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.177702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f906cb8-2308-4c92-a73d-4beca9363aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.177978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f906cb8-2308-4c92-a73d-4beca9363aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.178246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f906cb8-2308-4c92-a73d-4beca9363aa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.208921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.250756 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f906cb8-2308-4c92-a73d-4beca9363aa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.252121 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f906cb8-2308-4c92-a73d-4beca9363aa2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.380678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 612/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:48:14.387270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9895-1d04-4d98-a63f-a16370b9b2ec None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.412157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.503113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9895-1d04-4d98-a63f-a16370b9b2ec None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.539634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d59c91-b422-4f53-afd6-1fd9084f6d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.540349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d59c91-b422-4f53-afd6-1fd9084f6d12 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.540635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d59c91-b422-4f53-afd6-1fd9084f6d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.540912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d59c91-b422-4f53-afd6-1fd9084f6d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.551353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d59c91-b422-4f53-afd6-1fd9084f6d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.552830 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d59c91-b422-4f53-afd6-1fd9084f6d12 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-99d59c91-b422-4f53-afd6-1fd9084f6d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:14.568745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:14.570047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:14.571187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:14.571187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:14.571187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:14.571187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:14.571187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 603/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:14.576484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f906cb8-2308-4c92-a73d-4beca9363aa2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.638129 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.675999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f906cb8-2308-4c92-a73d-4beca9363aa2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.710099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9ef16-fce3-47b1-b029-e5a54cac55a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.710716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9ef16-fce3-47b1-b029-e5a54cac55a9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.711000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9ef16-fce3-47b1-b029-e5a54cac55a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.711273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9ef16-fce3-47b1-b029-e5a54cac55a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.711965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9ef16-fce3-47b1-b029-e5a54cac55a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:14.712270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9ef16-fce3-47b1-b029-e5a54cac55a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.713676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9ef16-fce3-47b1-b029-e5a54cac55a9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.725158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 613/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:14.731377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d59c91-b422-4f53-afd6-1fd9084f6d12 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.803731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.835562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d59c91-b422-4f53-afd6-1fd9084f6d12 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.872422 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ae54d-eb03-4f93-a829-f709d6f15d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.873070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ae54d-eb03-4f93-a829-f709d6f15d45 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.873380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ae54d-eb03-4f93-a829-f709d6f15d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.873701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ae54d-eb03-4f93-a829-f709d6f15d45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.880573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ae54d-eb03-4f93-a829-f709d6f15d45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.882064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ae54d-eb03-4f93-a829-f709d6f15d45 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-982ae54d-eb03-4f93-a829-f709d6f15d45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:14.893486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:14.894567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:14.895872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:14.895872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:14.895872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:14.895872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:14.895872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:14.895872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:14.895872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:14.895872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:14.895872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 604/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:14.900661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9ef16-fce3-47b1-b029-e5a54cac55a9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.003702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9ef16-fce3-47b1-b029-e5a54cac55a9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.026943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:15.038925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297f65c-b1b9-47dc-83e1-3f3d0c8370fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.039538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297f65c-b1b9-47dc-83e1-3f3d0c8370fc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.039810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297f65c-b1b9-47dc-83e1-3f3d0c8370fc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.040082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297f65c-b1b9-47dc-83e1-3f3d0c8370fc None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.040824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297f65c-b1b9-47dc-83e1-3f3d0c8370fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:15.041145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297f65c-b1b9-47dc-83e1-3f3d0c8370fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.043962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297f65c-b1b9-47dc-83e1-3f3d0c8370fc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.056813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 614/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:15.063604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ae54d-eb03-4f93-a829-f709d6f15d45 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.169641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ae54d-eb03-4f93-a829-f709d6f15d45 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.198100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:15.204021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c140e-d39a-4127-9487-7793452ce6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.204631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c140e-d39a-4127-9487-7793452ce6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.204912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c140e-d39a-4127-9487-7793452ce6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.205219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c140e-d39a-4127-9487-7793452ce6d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.206007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c140e-d39a-4127-9487-7793452ce6d7 None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=0aa69689b82d4994beac3b698d40c37f) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:15.206318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c140e-d39a-4127-9487-7793452ce6d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.207752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c140e-d39a-4127-9487-7793452ce6d7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.213053 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 605/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:15 2022] GET /identity/v3/role_assignments?user.id=0aa69689b82d4994beac3b698d40c37f&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:17.208567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7ced-3fee-4eb9-9f2a-5bc48d42f7ec None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.209083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7ced-3fee-4eb9-9f2a-5bc48d42f7ec None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.209083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7ced-3fee-4eb9-9f2a-5bc48d42f7ec None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.210415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 615/1220] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:17.216366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f69221-4377-425b-a7f1-d5a0728ead75 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.216768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f69221-4377-425b-a7f1-d5a0728ead75 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.216902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f69221-4377-425b-a7f1-d5a0728ead75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.235060 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-40f69221-4377-425b-a7f1-d5a0728ead75 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:17.236263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-40f69221-4377-425b-a7f1-d5a0728ead75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:17.304858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 606/1221] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:17.328607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7ced-3fee-4eb9-9f2a-5bc48d42f7ec None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:17.429646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7ced-3fee-4eb9-9f2a-5bc48d42f7ec None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:17.465007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e7fcc-fe62-402e-8d3c-ff1554a8eba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:17.482983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e7fcc-fe62-402e-8d3c-ff1554a8eba2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.482983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e7fcc-fe62-402e-8d3c-ff1554a8eba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.482983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e7fcc-fe62-402e-8d3c-ff1554a8eba2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.482983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e7fcc-fe62-402e-8d3c-ff1554a8eba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:17.482983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-307e7fcc-fe62-402e-8d3c-ff1554a8eba2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:17.482983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:17.482983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:17.482983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:17.482983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:17.483760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:17.484823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:17.485951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:17.485951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:17.485951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:17.485951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:17.485951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:17.485951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:17.485951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 616/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:17.488228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f69221-4377-425b-a7f1-d5a0728ead75 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:17.591085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f69221-4377-425b-a7f1-d5a0728ead75 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:17.617692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:17.629200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae073e-d994-40af-8c30-a3ac28a92f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:17.629831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae073e-d994-40af-8c30-a3ac28a92f7e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.630107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae073e-d994-40af-8c30-a3ac28a92f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.630381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae073e-d994-40af-8c30-a3ac28a92f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.631167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae073e-d994-40af-8c30-a3ac28a92f7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:17.631405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae073e-d994-40af-8c30-a3ac28a92f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:17.632795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae073e-d994-40af-8c30-a3ac28a92f7e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:17.641891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 607/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:17.647764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e7fcc-fe62-402e-8d3c-ff1554a8eba2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:17.693729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:17.750772 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e7fcc-fe62-402e-8d3c-ff1554a8eba2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:17.785086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796352-2fc3-467a-b32f-a20122c440cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:17.785736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796352-2fc3-467a-b32f-a20122c440cf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.786012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796352-2fc3-467a-b32f-a20122c440cf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.786282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796352-2fc3-467a-b32f-a20122c440cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.797541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e796352-2fc3-467a-b32f-a20122c440cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:17.799012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e796352-2fc3-467a-b32f-a20122c440cf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5e796352-2fc3-467a-b32f-a20122c440cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:17.814458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:17.815595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:17.816514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:17.816514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:17.816514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:17.816514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:17.816514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 617/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:17.821528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae073e-d994-40af-8c30-a3ac28a92f7e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:17.921865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae073e-d994-40af-8c30-a3ac28a92f7e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:17.955446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b49c-aceb-4795-b276-3495fb6ac560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:17.956040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b49c-aceb-4795-b276-3495fb6ac560 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.957676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b49c-aceb-4795-b276-3495fb6ac560 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.957676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b49c-aceb-4795-b276-3495fb6ac560 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.957676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484b49c-aceb-4795-b276-3495fb6ac560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:17.957676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484b49c-aceb-4795-b276-3495fb6ac560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:17.958967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484b49c-aceb-4795-b276-3495fb6ac560 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:17.970940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 608/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:17.976641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796352-2fc3-467a-b32f-a20122c440cf None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.072904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:18.080407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796352-2fc3-467a-b32f-a20122c440cf None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.114929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2273b-114c-44a0-be68-719404666c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.115568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2273b-114c-44a0-be68-719404666c3d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.115852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2273b-114c-44a0-be68-719404666c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.116126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2273b-114c-44a0-be68-719404666c3d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.125764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2273b-114c-44a0-be68-719404666c3d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.127259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2273b-114c-44a0-be68-719404666c3d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7ac2273b-114c-44a0-be68-719404666c3d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:18.139319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:18.140460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:18.141494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 618/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:18.146679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b49c-aceb-4795-b276-3495fb6ac560 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.194607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:18.250188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b49c-aceb-4795-b276-3495fb6ac560 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.285213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd527fb-ef5e-49c2-99a6-4bcfe95578ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.285830 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd527fb-ef5e-49c2-99a6-4bcfe95578ef None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.286113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd527fb-ef5e-49c2-99a6-4bcfe95578ef None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.286391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd527fb-ef5e-49c2-99a6-4bcfe95578ef None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.287182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd527fb-ef5e-49c2-99a6-4bcfe95578ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:18.287489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd527fb-ef5e-49c2-99a6-4bcfe95578ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.288925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd527fb-ef5e-49c2-99a6-4bcfe95578ef None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.307370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 609/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:18.314470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2273b-114c-44a0-be68-719404666c3d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.417146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2273b-114c-44a0-be68-719404666c3d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.451342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3070a4-dd2a-4439-ba95-bb7f0027fc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.451980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3070a4-dd2a-4439-ba95-bb7f0027fc0d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.452258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3070a4-dd2a-4439-ba95-bb7f0027fc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.452532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3070a4-dd2a-4439-ba95-bb7f0027fc0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.463037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3070a4-dd2a-4439-ba95-bb7f0027fc0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.465094 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3070a4-dd2a-4439-ba95-bb7f0027fc0d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-eb3070a4-dd2a-4439-ba95-bb7f0027fc0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:18.479176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:18.480728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:18.482196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:18.482196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:18.482196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:18.482196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:18.482196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 619/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:18.486254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd527fb-ef5e-49c2-99a6-4bcfe95578ef None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.586176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd527fb-ef5e-49c2-99a6-4bcfe95578ef None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.588500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:18.622741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083f6c1-9526-4249-b294-5dddef955764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.623367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083f6c1-9526-4249-b294-5dddef955764 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.623676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083f6c1-9526-4249-b294-5dddef955764 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.624015 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083f6c1-9526-4249-b294-5dddef955764 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.624702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083f6c1-9526-4249-b294-5dddef955764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:18.625005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083f6c1-9526-4249-b294-5dddef955764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.626485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083f6c1-9526-4249-b294-5dddef955764 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.638295 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 610/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:18.644059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3070a4-dd2a-4439-ba95-bb7f0027fc0d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.656276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:18.748579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3070a4-dd2a-4439-ba95-bb7f0027fc0d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.782899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994d34f-fd7f-497d-84ba-ad142fab7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.783620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994d34f-fd7f-497d-84ba-ad142fab7890 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.783893 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994d34f-fd7f-497d-84ba-ad142fab7890 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.784161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994d34f-fd7f-497d-84ba-ad142fab7890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.790804 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994d34f-fd7f-497d-84ba-ad142fab7890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.793019 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994d34f-fd7f-497d-84ba-ad142fab7890 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-3994d34f-fd7f-497d-84ba-ad142fab7890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:18.804471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:18.805478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:18.806381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:18.806381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:18.806381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:18.806381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:18.806381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:18.806381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:18.806381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:18.806381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:18.806381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 620/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:18.812224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083f6c1-9526-4249-b294-5dddef955764 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.914343 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083f6c1-9526-4249-b294-5dddef955764 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.950172 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2f4d1-9776-493e-b497-bb70fec0f837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.950784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f4d1-9776-493e-b497-bb70fec0f837 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.951065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f4d1-9776-493e-b497-bb70fec0f837 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.951335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f4d1-9776-493e-b497-bb70fec0f837 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.952079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2f4d1-9776-493e-b497-bb70fec0f837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:18.952386 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2f4d1-9776-493e-b497-bb70fec0f837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.953906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2f4d1-9776-493e-b497-bb70fec0f837 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.966440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 611/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:18.972531 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994d34f-fd7f-497d-84ba-ad142fab7890 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.040676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:19.078200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994d34f-fd7f-497d-84ba-ad142fab7890 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.113228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb68862-e08a-4a74-900d-bb95825ab160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.113888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb68862-e08a-4a74-900d-bb95825ab160 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.114165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb68862-e08a-4a74-900d-bb95825ab160 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.114435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb68862-e08a-4a74-900d-bb95825ab160 None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/0aa69689b82d4994beac3b698d40c37f/roles/7b381eede31e433d8686d9ffae1da02c` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.129747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb68862-e08a-4a74-900d-bb95825ab160 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=0aa69689b82d4994beac3b698d40c37f, role_id=7b381eede31e433d8686d9ffae1da02c)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:19.131174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb68862-e08a-4a74-900d-bb95825ab160 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:19.218426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 621/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:48:18 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/0aa69689b82d4994beac3b698d40c37f/roles/7b381eede31e433d8686d9ffae1da02c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:48:21.237297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ac45-46e9-456b-8e91-f16df05d07dc None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.237792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ac45-46e9-456b-8e91-f16df05d07dc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.237792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ac45-46e9-456b-8e91-f16df05d07dc None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.239174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 612/1233] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:21.244213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0ff9-18f8-44c3-a7e0-b82ecb9fd28d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.244660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0ff9-18f8-44c3-a7e0-b82ecb9fd28d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.244751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0ff9-18f8-44c3-a7e0-b82ecb9fd28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.262798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e6be0ff9-18f8-44c3-a7e0-b82ecb9fd28d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:21.263996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e6be0ff9-18f8-44c3-a7e0-b82ecb9fd28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:21.332602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 622/1234] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:21.356526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069ac45-46e9-456b-8e91-f16df05d07dc None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.382011 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.461290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069ac45-46e9-456b-8e91-f16df05d07dc None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.496505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32196086-2bf7-47df-92e1-d5eb74f3a26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.497052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196086-2bf7-47df-92e1-d5eb74f3a26d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.497359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196086-2bf7-47df-92e1-d5eb74f3a26d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.497631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196086-2bf7-47df-92e1-d5eb74f3a26d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.507414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32196086-2bf7-47df-92e1-d5eb74f3a26d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-32196086-2bf7-47df-92e1-d5eb74f3a26d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:21.513405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:21.514536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:21.520494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 613/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:21.521249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0ff9-18f8-44c3-a7e0-b82ecb9fd28d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.569786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.623986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0ff9-18f8-44c3-a7e0-b82ecb9fd28d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.659752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06c379-a622-42ae-83fe-c6025eea8079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.660369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c379-a622-42ae-83fe-c6025eea8079 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.660651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c379-a622-42ae-83fe-c6025eea8079 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.660922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c379-a622-42ae-83fe-c6025eea8079 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.661666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06c379-a622-42ae-83fe-c6025eea8079 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:21.661972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06c379-a622-42ae-83fe-c6025eea8079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.663338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06c379-a622-42ae-83fe-c6025eea8079 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:21.672086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 623/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:21.677974 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32196086-2bf7-47df-92e1-d5eb74f3a26d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.766419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.783537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32196086-2bf7-47df-92e1-d5eb74f3a26d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.818296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25b6c8-35b7-4ec8-a90d-f57c4fcec59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.818935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25b6c8-35b7-4ec8-a90d-f57c4fcec59c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.819217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25b6c8-35b7-4ec8-a90d-f57c4fcec59c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.819493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25b6c8-35b7-4ec8-a90d-f57c4fcec59c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.829544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25b6c8-35b7-4ec8-a90d-f57c4fcec59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.831004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25b6c8-35b7-4ec8-a90d-f57c4fcec59c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-ca25b6c8-35b7-4ec8-a90d-f57c4fcec59c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:21.847188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:21.848303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:21.849391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:21.849391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:21.849391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:21.849391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:21.849391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 614/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:21.855168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06c379-a622-42ae-83fe-c6025eea8079 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.959212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06c379-a622-42ae-83fe-c6025eea8079 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.968618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.992973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63364117-3bce-4961-a728-a74daad72ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.993620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63364117-3bce-4961-a728-a74daad72ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.993901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63364117-3bce-4961-a728-a74daad72ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.994174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63364117-3bce-4961-a728-a74daad72ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.994914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63364117-3bce-4961-a728-a74daad72ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:21.995461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63364117-3bce-4961-a728-a74daad72ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.996623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63364117-3bce-4961-a728-a74daad72ba6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.008919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 624/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:22.014758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25b6c8-35b7-4ec8-a90d-f57c4fcec59c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.116953 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25b6c8-35b7-4ec8-a90d-f57c4fcec59c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.151577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db6c9-d8c9-4ecd-a6d1-f041e5fbb8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.152208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db6c9-d8c9-4ecd-a6d1-f041e5fbb8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.152631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db6c9-d8c9-4ecd-a6d1-f041e5fbb8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.153475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db6c9-d8c9-4ecd-a6d1-f041e5fbb8f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.158645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:22.164651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71db6c9-d8c9-4ecd-a6d1-f041e5fbb8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.166156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71db6c9-d8c9-4ecd-a6d1-f041e5fbb8f3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b71db6c9-d8c9-4ecd-a6d1-f041e5fbb8f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:22.178218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:22.179284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:22.180560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 615/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:22.185618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63364117-3bce-4961-a728-a74daad72ba6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.289509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63364117-3bce-4961-a728-a74daad72ba6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.324748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc68d11-f254-4cfd-9588-13d154dd6a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.325504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc68d11-f254-4cfd-9588-13d154dd6a7c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.325788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc68d11-f254-4cfd-9588-13d154dd6a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.326059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc68d11-f254-4cfd-9588-13d154dd6a7c None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.326862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc68d11-f254-4cfd-9588-13d154dd6a7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:22.327164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc68d11-f254-4cfd-9588-13d154dd6a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.328619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc68d11-f254-4cfd-9588-13d154dd6a7c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.346847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 625/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:22.352531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db6c9-d8c9-4ecd-a6d1-f041e5fbb8f3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.458417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db6c9-d8c9-4ecd-a6d1-f041e5fbb8f3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.493445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fea53-dad9-49e3-a095-f95187b76386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.494059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fea53-dad9-49e3-a095-f95187b76386 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.494342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fea53-dad9-49e3-a095-f95187b76386 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.494619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fea53-dad9-49e3-a095-f95187b76386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.558655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:22.565954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fea53-dad9-49e3-a095-f95187b76386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.567558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fea53-dad9-49e3-a095-f95187b76386 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.666990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 616/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:48:22.673868 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc68d11-f254-4cfd-9588-13d154dd6a7c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.701849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:22.776751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc68d11-f254-4cfd-9588-13d154dd6a7c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.812648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8e2c-ec9d-4604-8a0b-61f1aa448a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.813318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8e2c-ec9d-4604-8a0b-61f1aa448a6e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.813607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8e2c-ec9d-4604-8a0b-61f1aa448a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.813881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8e2c-ec9d-4604-8a0b-61f1aa448a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.826041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8e2c-ec9d-4604-8a0b-61f1aa448a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.827506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8e2c-ec9d-4604-8a0b-61f1aa448a6e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7d8c8e2c-ec9d-4604-8a0b-61f1aa448a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:22.842793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:22.843912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:22.849148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:22.849148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:22.849148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:22.849148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:22.849148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 626/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:22.850773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fea53-dad9-49e3-a095-f95187b76386 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.947229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:22.953815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fea53-dad9-49e3-a095-f95187b76386 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.991089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb0715-72c0-4ae6-85c7-c586695a6025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.991716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0715-72c0-4ae6-85c7-c586695a6025 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.991997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0715-72c0-4ae6-85c7-c586695a6025 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.992269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0715-72c0-4ae6-85c7-c586695a6025 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.992961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb0715-72c0-4ae6-85c7-c586695a6025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:22.993329 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb0715-72c0-4ae6-85c7-c586695a6025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.994704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb0715-72c0-4ae6-85c7-c586695a6025 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:23.006836 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 617/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:23.013452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8e2c-ec9d-4604-8a0b-61f1aa448a6e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:23.096884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:23.118597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8e2c-ec9d-4604-8a0b-61f1aa448a6e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:23.153989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a1497-4d32-49da-9d26-4790359e7f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:23.154635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a1497-4d32-49da-9d26-4790359e7f00 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:23.154917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a1497-4d32-49da-9d26-4790359e7f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:23.155191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a1497-4d32-49da-9d26-4790359e7f00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:23.162455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a1497-4d32-49da-9d26-4790359e7f00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:23.164447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a1497-4d32-49da-9d26-4790359e7f00 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-100a1497-4d32-49da-9d26-4790359e7f00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:23.176689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:23.180188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:23.181297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:23.181297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:23.181297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:23.181297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:23.181297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:23.181297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:23.181297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:23.181297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:23.181297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 627/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:23.184015 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb0715-72c0-4ae6-85c7-c586695a6025 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:23.287774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb0715-72c0-4ae6-85c7-c586695a6025 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:23.322687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c3e82-cee9-44d1-9e1a-20f3f6645436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:23.323310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3e82-cee9-44d1-9e1a-20f3f6645436 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:23.323595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3e82-cee9-44d1-9e1a-20f3f6645436 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:23.323873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3e82-cee9-44d1-9e1a-20f3f6645436 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:23.325271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c3e82-cee9-44d1-9e1a-20f3f6645436 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:23.325566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c3e82-cee9-44d1-9e1a-20f3f6645436 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:23.327055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c3e82-cee9-44d1-9e1a-20f3f6645436 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:23.339770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 618/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:23.346517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a1497-4d32-49da-9d26-4790359e7f00 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:23.455180 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a1497-4d32-49da-9d26-4790359e7f00 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:23.491501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f4e9a-c8a9-4e26-a623-c1574c8baada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:23.492163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f4e9a-c8a9-4e26-a623-c1574c8baada None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:23.492443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f4e9a-c8a9-4e26-a623-c1574c8baada None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:23.492714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f4e9a-c8a9-4e26-a623-c1574c8baada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:23.493542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f4e9a-c8a9-4e26-a623-c1574c8baada None admin] RBAC: Adding query filter params (role.id=7b381eede31e433d8686d9ffae1da02c, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=0aa69689b82d4994beac3b698d40c37f) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:23.493854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f4e9a-c8a9-4e26-a623-c1574c8baada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:23.495294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f4e9a-c8a9-4e26-a623-c1574c8baada None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:23.502062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 628/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:23 2022] GET /identity/v3/role_assignments?user.id=0aa69689b82d4994beac3b698d40c37f&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=7b381eede31e433d8686d9ffae1da02c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:25.633640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90346f5-a4b8-481c-b509-c7ad6aa1e837 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.634285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90346f5-a4b8-481c-b509-c7ad6aa1e837 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.634285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90346f5-a4b8-481c-b509-c7ad6aa1e837 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.635620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 619/1247] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:25.641835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d808d1-10c3-4baf-ae71-1a127b8f0b90 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.646630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d808d1-10c3-4baf-ae71-1a127b8f0b90 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.646630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d808d1-10c3-4baf-ae71-1a127b8f0b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.649992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:25.662896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c4d808d1-10c3-4baf-ae71-1a127b8f0b90 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:25.664488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c4d808d1-10c3-4baf-ae71-1a127b8f0b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:25.732643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 629/1248] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:25.757098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90346f5-a4b8-481c-b509-c7ad6aa1e837 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:25.776699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:25.868315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90346f5-a4b8-481c-b509-c7ad6aa1e837 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:25.904477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34d32-c7c0-4ac1-8944-1c94ba8f10bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:25.905037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34d32-c7c0-4ac1-8944-1c94ba8f10bc None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.905347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34d32-c7c0-4ac1-8944-1c94ba8f10bc None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.905621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34d32-c7c0-4ac1-8944-1c94ba8f10bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.915618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd34d32-c7c0-4ac1-8944-1c94ba8f10bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-2cd34d32-c7c0-4ac1-8944-1c94ba8f10bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:25.920999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:25.922437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:25.923537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 620/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:48:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:25.928801 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d808d1-10c3-4baf-ae71-1a127b8f0b90 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:26.031649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d808d1-10c3-4baf-ae71-1a127b8f0b90 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:26.062467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:26.067721 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ddc9-dc88-4c8a-b4b7-229d2048099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:26.068349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ddc9-dc88-4c8a-b4b7-229d2048099e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:26.068630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ddc9-dc88-4c8a-b4b7-229d2048099e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:26.068955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ddc9-dc88-4c8a-b4b7-229d2048099e None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:26.069656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53ddc9-dc88-4c8a-b4b7-229d2048099e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:26.069951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53ddc9-dc88-4c8a-b4b7-229d2048099e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:26.071306 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53ddc9-dc88-4c8a-b4b7-229d2048099e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:26.079455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 630/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:26.085463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34d32-c7c0-4ac1-8944-1c94ba8f10bc None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:26.164153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:26.188205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34d32-c7c0-4ac1-8944-1c94ba8f10bc None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:26.221913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51e185-c510-49c0-862d-630adb352dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:26.222554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51e185-c510-49c0-862d-630adb352dcb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:26.222833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51e185-c510-49c0-862d-630adb352dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:26.223107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51e185-c510-49c0-862d-630adb352dcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:26.234377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51e185-c510-49c0-862d-630adb352dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:26.235834 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51e185-c510-49c0-862d-630adb352dcb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-ab51e185-c510-49c0-862d-630adb352dcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:26.250737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:26.251864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:26.253198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:26.253198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:26.253198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:26.253198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:26.253198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 621/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:26.257776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ddc9-dc88-4c8a-b4b7-229d2048099e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:26.361257 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ddc9-dc88-4c8a-b4b7-229d2048099e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:26.396648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d19c3-9340-409b-aa40-7fa1d1082617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:26.397271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d19c3-9340-409b-aa40-7fa1d1082617 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:26.397582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d19c3-9340-409b-aa40-7fa1d1082617 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:26.397936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d19c3-9340-409b-aa40-7fa1d1082617 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:26.398580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d19c3-9340-409b-aa40-7fa1d1082617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:26.398888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d19c3-9340-409b-aa40-7fa1d1082617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:26.400263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d19c3-9340-409b-aa40-7fa1d1082617 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:26.412879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 631/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:26.419997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51e185-c510-49c0-862d-630adb352dcb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:26.524937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51e185-c510-49c0-862d-630adb352dcb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:26.553219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:26.561073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b188-f446-4ec1-91c5-4ab30185d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:26.561742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b188-f446-4ec1-91c5-4ab30185d130 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:26.562046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b188-f446-4ec1-91c5-4ab30185d130 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:26.562318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b188-f446-4ec1-91c5-4ab30185d130 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:26.570760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09b188-f446-4ec1-91c5-4ab30185d130 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:26.577594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09b188-f446-4ec1-91c5-4ab30185d130 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-6d09b188-f446-4ec1-91c5-4ab30185d130 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:26.584180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:26.585384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:26.586730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 622/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:26.592064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d19c3-9340-409b-aa40-7fa1d1082617 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:26.649330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:26.694168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d19c3-9340-409b-aa40-7fa1d1082617 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:26.728270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b1e89-d644-4639-97b2-67791273988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:26.728888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1e89-d644-4639-97b2-67791273988d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:26.729199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1e89-d644-4639-97b2-67791273988d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:26.729475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1e89-d644-4639-97b2-67791273988d None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:26.730267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b1e89-d644-4639-97b2-67791273988d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:26.730730 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b1e89-d644-4639-97b2-67791273988d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:26.732169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b1e89-d644-4639-97b2-67791273988d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:26.750959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 632/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Mon Jul 25 22:48:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:26.757021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b188-f446-4ec1-91c5-4ab30185d130 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:26.857837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b188-f446-4ec1-91c5-4ab30185d130 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:26.892283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a064a-97b5-4189-8bd9-f70bb6a0044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:26.892933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a064a-97b5-4189-8bd9-f70bb6a0044b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:26.893249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a064a-97b5-4189-8bd9-f70bb6a0044b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:26.893525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a064a-97b5-4189-8bd9-f70bb6a0044b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:26.950358 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:26.962186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a064a-97b5-4189-8bd9-f70bb6a0044b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:26.963646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a064a-97b5-4189-8bd9-f70bb6a0044b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.064258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 623/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:48:27.070308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b1e89-d644-4639-97b2-67791273988d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.171596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b1e89-d644-4639-97b2-67791273988d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.186162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:27.207399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce5504-1ee0-4dfa-af91-504da90f7ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.207976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce5504-1ee0-4dfa-af91-504da90f7ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.208253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce5504-1ee0-4dfa-af91-504da90f7ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.208524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce5504-1ee0-4dfa-af91-504da90f7ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.218621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce5504-1ee0-4dfa-af91-504da90f7ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.220067 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce5504-1ee0-4dfa-af91-504da90f7ad1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-c3ce5504-1ee0-4dfa-af91-504da90f7ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:27.235545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:27.245446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:27.246914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:27.246914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:27.246914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:27.246914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:27.246914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 633/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:27.247215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a064a-97b5-4189-8bd9-f70bb6a0044b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.331427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:27.344106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a064a-97b5-4189-8bd9-f70bb6a0044b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.381828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37286ad-53ee-483e-972c-3655b1b9e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.382438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37286ad-53ee-483e-972c-3655b1b9e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.382715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37286ad-53ee-483e-972c-3655b1b9e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.382982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37286ad-53ee-483e-972c-3655b1b9e9b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.383660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37286ad-53ee-483e-972c-3655b1b9e9b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:27.383956 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37286ad-53ee-483e-972c-3655b1b9e9b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.385348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37286ad-53ee-483e-972c-3655b1b9e9b9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.397424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 624/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:27.403446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce5504-1ee0-4dfa-af91-504da90f7ad1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.504428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce5504-1ee0-4dfa-af91-504da90f7ad1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.537381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414b296-d4ef-4e76-bf0e-378dce90e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.538024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414b296-d4ef-4e76-bf0e-378dce90e623 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.538302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414b296-d4ef-4e76-bf0e-378dce90e623 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.538574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414b296-d4ef-4e76-bf0e-378dce90e623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.546348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414b296-d4ef-4e76-bf0e-378dce90e623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.547819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414b296-d4ef-4e76-bf0e-378dce90e623 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-8414b296-d4ef-4e76-bf0e-378dce90e623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:27.559812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:27.561083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:27.562300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:27.562300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:27.562300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:27.562300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:27.562300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:27.562300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:27.562300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:27.562300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:27.562300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 634/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:27.566998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37286ad-53ee-483e-972c-3655b1b9e9b9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.672781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37286ad-53ee-483e-972c-3655b1b9e9b9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.707082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a75fb1-1fc5-4aab-a4d0-f6930ee9181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.707692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a75fb1-1fc5-4aab-a4d0-f6930ee9181a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.707975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a75fb1-1fc5-4aab-a4d0-f6930ee9181a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.708247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a75fb1-1fc5-4aab-a4d0-f6930ee9181a None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.709017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a75fb1-1fc5-4aab-a4d0-f6930ee9181a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:27.709356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a75fb1-1fc5-4aab-a4d0-f6930ee9181a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.710791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a75fb1-1fc5-4aab-a4d0-f6930ee9181a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.723466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 625/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:27.729748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414b296-d4ef-4e76-bf0e-378dce90e623 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.756285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:27.832933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414b296-d4ef-4e76-bf0e-378dce90e623 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.868358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514ff8f-3026-48f6-b15d-a374bc7d6403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.868984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514ff8f-3026-48f6-b15d-a374bc7d6403 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.869299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514ff8f-3026-48f6-b15d-a374bc7d6403 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.869577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514ff8f-3026-48f6-b15d-a374bc7d6403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.870478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514ff8f-3026-48f6-b15d-a374bc7d6403 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=0aa69689b82d4994beac3b698d40c37f) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:27.870788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514ff8f-3026-48f6-b15d-a374bc7d6403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.872772 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514ff8f-3026-48f6-b15d-a374bc7d6403 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.878217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 635/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:27 2022] GET /identity/v3/role_assignments?user.id=0aa69689b82d4994beac3b698d40c37f&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:29.893229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db75d6-f6fa-4c6e-a2ac-d04e56dfad5e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:29.893775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db75d6-f6fa-4c6e-a2ac-d04e56dfad5e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:29.893775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db75d6-f6fa-4c6e-a2ac-d04e56dfad5e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:29.895114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 626/1261] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:29.900761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce89154-3823-40ea-93ad-6501b5901d4a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:29.901246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce89154-3823-40ea-93ad-6501b5901d4a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:29.901367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce89154-3823-40ea-93ad-6501b5901d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:29.921537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5ce89154-3823-40ea-93ad-6501b5901d4a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:29.924876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5ce89154-3823-40ea-93ad-6501b5901d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:29.994022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 636/1262] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:30.018631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db75d6-f6fa-4c6e-a2ac-d04e56dfad5e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.031227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:30.128412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db75d6-f6fa-4c6e-a2ac-d04e56dfad5e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.163070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5e617-e2c8-462d-9fe1-31e97a0852f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.164708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5e617-e2c8-462d-9fe1-31e97a0852f9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.164708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5e617-e2c8-462d-9fe1-31e97a0852f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.164708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5e617-e2c8-462d-9fe1-31e97a0852f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.176208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5e617-e2c8-462d-9fe1-31e97a0852f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7ec5e617-e2c8-462d-9fe1-31e97a0852f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:30.181008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:30.182780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:30.184684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 627/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:30.188526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce89154-3823-40ea-93ad-6501b5901d4a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.207485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:30.289713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce89154-3823-40ea-93ad-6501b5901d4a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.325035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96946d-0494-4307-b504-7a800758fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.325689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96946d-0494-4307-b504-7a800758fd53 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.325969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96946d-0494-4307-b504-7a800758fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.326242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96946d-0494-4307-b504-7a800758fd53 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.326956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96946d-0494-4307-b504-7a800758fd53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:30.327284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96946d-0494-4307-b504-7a800758fd53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:30.328623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96946d-0494-4307-b504-7a800758fd53 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:30.338385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 637/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:30.345023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5e617-e2c8-462d-9fe1-31e97a0852f9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.413781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:30.448005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5e617-e2c8-462d-9fe1-31e97a0852f9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.484081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46990d95-344b-4201-8ea9-7055d79f7b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.484724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46990d95-344b-4201-8ea9-7055d79f7b09 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.485004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46990d95-344b-4201-8ea9-7055d79f7b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.485310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46990d95-344b-4201-8ea9-7055d79f7b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.496371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46990d95-344b-4201-8ea9-7055d79f7b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:30.497903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46990d95-344b-4201-8ea9-7055d79f7b09 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-46990d95-344b-4201-8ea9-7055d79f7b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:30.512741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:30.513897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:30.515209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:30.515209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:30.515209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:30.515209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:30.515209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 628/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:30.519783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96946d-0494-4307-b504-7a800758fd53 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.602709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:30.620936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96946d-0494-4307-b504-7a800758fd53 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.655400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8a083-7aba-4b06-9b4c-fa279178f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.656018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8a083-7aba-4b06-9b4c-fa279178f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.656321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8a083-7aba-4b06-9b4c-fa279178f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.656572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8a083-7aba-4b06-9b4c-fa279178f4a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.657309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8a083-7aba-4b06-9b4c-fa279178f4a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:30.657616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8a083-7aba-4b06-9b4c-fa279178f4a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:30.659063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8a083-7aba-4b06-9b4c-fa279178f4a6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:30.672019 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 638/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:30.677855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46990d95-344b-4201-8ea9-7055d79f7b09 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.782209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46990d95-344b-4201-8ea9-7055d79f7b09 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.803936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:30.818592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f032f-97bf-428d-83cc-5cf858303cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.819237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f032f-97bf-428d-83cc-5cf858303cde None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.819517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f032f-97bf-428d-83cc-5cf858303cde None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.819790 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f032f-97bf-428d-83cc-5cf858303cde None admin] PATH_INFO: `/v3/users/placement` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.828915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f032f-97bf-428d-83cc-5cf858303cde None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:30.830402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f032f-97bf-428d-83cc-5cf858303cde None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-862f032f-97bf-428d-83cc-5cf858303cde None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:30.842246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:30.843455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:30.844438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 629/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:30.849378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8a083-7aba-4b06-9b4c-fa279178f4a6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.951164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8a083-7aba-4b06-9b4c-fa279178f4a6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.987234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39649005-5299-455a-ae84-66557b4cd422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.987849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39649005-5299-455a-ae84-66557b4cd422 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.988127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39649005-5299-455a-ae84-66557b4cd422 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.988399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39649005-5299-455a-ae84-66557b4cd422 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.989224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39649005-5299-455a-ae84-66557b4cd422 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:30.989529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39649005-5299-455a-ae84-66557b4cd422 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:30.990991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39649005-5299-455a-ae84-66557b4cd422 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.002267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:31.024064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 639/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:31.030190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f032f-97bf-428d-83cc-5cf858303cde None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.135279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f032f-97bf-428d-83cc-5cf858303cde None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.170655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f22e0e-d6e9-4c51-ae8a-ef8d196b8f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.171564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f22e0e-d6e9-4c51-ae8a-ef8d196b8f9e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.171844 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f22e0e-d6e9-4c51-ae8a-ef8d196b8f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.172117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f22e0e-d6e9-4c51-ae8a-ef8d196b8f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.183012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f22e0e-d6e9-4c51-ae8a-ef8d196b8f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.185437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f22e0e-d6e9-4c51-ae8a-ef8d196b8f9e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-08f22e0e-d6e9-4c51-ae8a-ef8d196b8f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:31.199881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:31.201145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:31.206106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:31.206106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:31.206106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:31.206106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:31.206106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 630/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:31.207257 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39649005-5299-455a-ae84-66557b4cd422 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.310640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39649005-5299-455a-ae84-66557b4cd422 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.350624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cac166-321e-42b6-aa90-923b11e06f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.351245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cac166-321e-42b6-aa90-923b11e06f33 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.351526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cac166-321e-42b6-aa90-923b11e06f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.351799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cac166-321e-42b6-aa90-923b11e06f33 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.352493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cac166-321e-42b6-aa90-923b11e06f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:31.352795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cac166-321e-42b6-aa90-923b11e06f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.354260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cac166-321e-42b6-aa90-923b11e06f33 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.366636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 640/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:31.372674 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f22e0e-d6e9-4c51-ae8a-ef8d196b8f9e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.405031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:31.473269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f22e0e-d6e9-4c51-ae8a-ef8d196b8f9e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.508699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed24f1-d264-486c-9ad0-f08f7fa4c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.509361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed24f1-d264-486c-9ad0-f08f7fa4c0ef None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.509643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed24f1-d264-486c-9ad0-f08f7fa4c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.509918 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed24f1-d264-486c-9ad0-f08f7fa4c0ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.517653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed24f1-d264-486c-9ad0-f08f7fa4c0ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.519139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed24f1-d264-486c-9ad0-f08f7fa4c0ef None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-44ed24f1-d264-486c-9ad0-f08f7fa4c0ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:31.530427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:31.531745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:31.532845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:31.532845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:31.532845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:31.532845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:31.532845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:31.532845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:31.532845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:31.532845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:31.532845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 631/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:31.537513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cac166-321e-42b6-aa90-923b11e06f33 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.596184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:31.637939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cac166-321e-42b6-aa90-923b11e06f33 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.671716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4508-be37-4bc7-af63-e11e5dad86de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.672351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4508-be37-4bc7-af63-e11e5dad86de None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.672714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4508-be37-4bc7-af63-e11e5dad86de None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.672910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4508-be37-4bc7-af63-e11e5dad86de None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.673710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a4508-be37-4bc7-af63-e11e5dad86de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:31.674211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a4508-be37-4bc7-af63-e11e5dad86de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.676510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a4508-be37-4bc7-af63-e11e5dad86de None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.689724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 641/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:31.696203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed24f1-d264-486c-9ad0-f08f7fa4c0ef None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.791563 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:31.800669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed24f1-d264-486c-9ad0-f08f7fa4c0ef None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.834769 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868a960-b823-47ea-ba10-4c42c6968097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.835424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868a960-b823-47ea-ba10-4c42c6968097 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.835701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868a960-b823-47ea-ba10-4c42c6968097 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.835971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868a960-b823-47ea-ba10-4c42c6968097 None admin] PATH_INFO: `/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/0aa69689b82d4994beac3b698d40c37f/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.837894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868a960-b823-47ea-ba10-4c42c6968097 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f10d3e6c5c24ebabb0c7cde9794c47d, user_id=0aa69689b82d4994beac3b698d40c37f, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.839322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868a960-b823-47ea-ba10-4c42c6968097 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.987307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 632/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Mon Jul 25 22:48:31 2022] PUT /identity/v3/projects/5f10d3e6c5c24ebabb0c7cde9794c47d/users/0aa69689b82d4994beac3b698d40c37f/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:48:33.978004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3468ee-c179-459b-abb4-09a16a95c97b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.978563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3468ee-c179-459b-abb4-09a16a95c97b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.978563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3468ee-c179-459b-abb4-09a16a95c97b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:33.979900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 642/1274] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:33.985355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d3dca-a6e5-494f-aff9-469b6cbdcc66 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.985854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d3dca-a6e5-494f-aff9-469b6cbdcc66 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.985949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d3dca-a6e5-494f-aff9-469b6cbdcc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.005453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-cc2d3dca-a6e5-494f-aff9-469b6cbdcc66 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:34.006672 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cc2d3dca-a6e5-494f-aff9-469b6cbdcc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:34.075792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 633/1275] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:34.099020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3468ee-c179-459b-abb4-09a16a95c97b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.205482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3468ee-c179-459b-abb4-09a16a95c97b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.224322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:34.240877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5140-d52f-4a3d-a77c-d7e8e444abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.241546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5140-d52f-4a3d-a77c-d7e8e444abce None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.241823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5140-d52f-4a3d-a77c-d7e8e444abce None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.242091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5140-d52f-4a3d-a77c-d7e8e444abce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.252013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5140-d52f-4a3d-a77c-d7e8e444abce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-510d5140-d52f-4a3d-a77c-d7e8e444abce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:34.256906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:34.258572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:34.259554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 643/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:34.265205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d3dca-a6e5-494f-aff9-469b6cbdcc66 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.353137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:34.373208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d3dca-a6e5-494f-aff9-469b6cbdcc66 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.407908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f7202-107a-4d38-8f69-4b8fc2d225d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.408518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f7202-107a-4d38-8f69-4b8fc2d225d3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.408797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f7202-107a-4d38-8f69-4b8fc2d225d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.409070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f7202-107a-4d38-8f69-4b8fc2d225d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.409806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f7202-107a-4d38-8f69-4b8fc2d225d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:34.410141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f7202-107a-4d38-8f69-4b8fc2d225d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:34.411503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f7202-107a-4d38-8f69-4b8fc2d225d3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:34.420548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 634/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:34.426653 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5140-d52f-4a3d-a77c-d7e8e444abce None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.534366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5140-d52f-4a3d-a77c-d7e8e444abce None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.568493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae46ec-0714-4748-866c-8bcd3d68336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.569149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae46ec-0714-4748-866c-8bcd3d68336b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.569433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae46ec-0714-4748-866c-8bcd3d68336b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.569703 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae46ec-0714-4748-866c-8bcd3d68336b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.579966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae46ec-0714-4748-866c-8bcd3d68336b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:34.582072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae46ec-0714-4748-866c-8bcd3d68336b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-31ae46ec-0714-4748-866c-8bcd3d68336b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:34.597541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:34.598709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:34.600036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:34.600036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:34.600036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:34.600036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:34.600036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 644/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:34.604635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f7202-107a-4d38-8f69-4b8fc2d225d3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.710240 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f7202-107a-4d38-8f69-4b8fc2d225d3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.743323 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eea9a5-546b-4790-8a30-b1cc13446e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.743927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eea9a5-546b-4790-8a30-b1cc13446e8c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.744205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eea9a5-546b-4790-8a30-b1cc13446e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.744480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eea9a5-546b-4790-8a30-b1cc13446e8c None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.745175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eea9a5-546b-4790-8a30-b1cc13446e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:34.745482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eea9a5-546b-4790-8a30-b1cc13446e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:34.747659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eea9a5-546b-4790-8a30-b1cc13446e8c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:34.759170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 635/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:34.765735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae46ec-0714-4748-866c-8bcd3d68336b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.798931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:34.869335 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae46ec-0714-4748-866c-8bcd3d68336b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.904752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1f4d-f85e-4558-9286-5d76c633b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.905439 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1f4d-f85e-4558-9286-5d76c633b3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.905713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1f4d-f85e-4558-9286-5d76c633b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.905984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1f4d-f85e-4558-9286-5d76c633b3a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.913767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1f4d-f85e-4558-9286-5d76c633b3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:34.915201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1f4d-f85e-4558-9286-5d76c633b3a1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-0e4e1f4d-f85e-4558-9286-5d76c633b3a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:34.927470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:34.932324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:34.934389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 645/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:34.935464 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eea9a5-546b-4790-8a30-b1cc13446e8c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.939417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:35.034676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eea9a5-546b-4790-8a30-b1cc13446e8c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:35.069805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497b022-160a-4599-89cf-0e87ae892746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:35.070340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497b022-160a-4599-89cf-0e87ae892746 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:35.070616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497b022-160a-4599-89cf-0e87ae892746 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:35.070886 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497b022-160a-4599-89cf-0e87ae892746 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:35.071671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497b022-160a-4599-89cf-0e87ae892746 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:35.071974 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497b022-160a-4599-89cf-0e87ae892746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:35.073473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497b022-160a-4599-89cf-0e87ae892746 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:35.091362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 636/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:35.097420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1f4d-f85e-4558-9286-5d76c633b3a1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:35.190971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:35.200533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1f4d-f85e-4558-9286-5d76c633b3a1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:35.233769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061a9c1-ec24-4cce-b921-89de1fd2e7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:35.234389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a9c1-ec24-4cce-b921-89de1fd2e7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:35.234669 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a9c1-ec24-4cce-b921-89de1fd2e7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:35.234943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a9c1-ec24-4cce-b921-89de1fd2e7f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:35.302852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061a9c1-ec24-4cce-b921-89de1fd2e7f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:35.304357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061a9c1-ec24-4cce-b921-89de1fd2e7f1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:35.395276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:35.407177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 646/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:48:35.413245 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497b022-160a-4599-89cf-0e87ae892746 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:35.478396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:35.516352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497b022-160a-4599-89cf-0e87ae892746 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:35.550661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781fdd8-44a6-465f-b16f-1579ddfad45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:35.551294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781fdd8-44a6-465f-b16f-1579ddfad45e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:35.551577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781fdd8-44a6-465f-b16f-1579ddfad45e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:35.551848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781fdd8-44a6-465f-b16f-1579ddfad45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:35.562783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781fdd8-44a6-465f-b16f-1579ddfad45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:35.564238 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781fdd8-44a6-465f-b16f-1579ddfad45e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1781fdd8-44a6-465f-b16f-1579ddfad45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:35.578878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:35.579976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:35.580890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:35.580890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:35.580890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:35.580890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:35.580890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 637/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:35.585852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061a9c1-ec24-4cce-b921-89de1fd2e7f1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:35.685946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061a9c1-ec24-4cce-b921-89de1fd2e7f1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:35.721820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c90071-519e-4b56-b636-6d9d84d1981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:35.722448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c90071-519e-4b56-b636-6d9d84d1981e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:35.722730 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c90071-519e-4b56-b636-6d9d84d1981e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:35.723003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c90071-519e-4b56-b636-6d9d84d1981e None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:35.723728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c90071-519e-4b56-b636-6d9d84d1981e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:35.724035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c90071-519e-4b56-b636-6d9d84d1981e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:35.725437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c90071-519e-4b56-b636-6d9d84d1981e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:35.738301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 647/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:35.744056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781fdd8-44a6-465f-b16f-1579ddfad45e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:35.853920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781fdd8-44a6-465f-b16f-1579ddfad45e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:35.869969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:35.894444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b5110-79d1-4aa2-bc92-adb1869b8257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:35.895495 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b5110-79d1-4aa2-bc92-adb1869b8257 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:35.895983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b5110-79d1-4aa2-bc92-adb1869b8257 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:35.896384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b5110-79d1-4aa2-bc92-adb1869b8257 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:35.907634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b5110-79d1-4aa2-bc92-adb1869b8257 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:35.910108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b5110-79d1-4aa2-bc92-adb1869b8257 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-2a5b5110-79d1-4aa2-bc92-adb1869b8257 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:35.928275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:35.929416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:35.930420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:35.930420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:35.930420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:35.930420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:35.930420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:35.930420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:35.930420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:35.930420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jul 25 22:48:35.930420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 638/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:35.943254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c90071-519e-4b56-b636-6d9d84d1981e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:35.990213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:36.044749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c90071-519e-4b56-b636-6d9d84d1981e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:36.081038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9c430-4f85-4626-b964-eef6d2c129b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:36.081686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c430-4f85-4626-b964-eef6d2c129b4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:36.081966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c430-4f85-4626-b964-eef6d2c129b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:36.082247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c430-4f85-4626-b964-eef6d2c129b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:36.082998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9c430-4f85-4626-b964-eef6d2c129b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:36.083301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9c430-4f85-4626-b964-eef6d2c129b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:36.084745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9c430-4f85-4626-b964-eef6d2c129b4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:36.098189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 648/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:36.104589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b5110-79d1-4aa2-bc92-adb1869b8257 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:36.205803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b5110-79d1-4aa2-bc92-adb1869b8257 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:36.239751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48691a1f-ee95-488e-aa14-879765e7c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:36.240361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48691a1f-ee95-488e-aa14-879765e7c872 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:36.240646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48691a1f-ee95-488e-aa14-879765e7c872 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:36.240917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48691a1f-ee95-488e-aa14-879765e7c872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:36.241733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48691a1f-ee95-488e-aa14-879765e7c872 None admin] RBAC: Adding query filter params (role.id=2fc9bc07a4f843ec8270a6b097a81ec1, scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d, user.id=0aa69689b82d4994beac3b698d40c37f) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:36.242041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48691a1f-ee95-488e-aa14-879765e7c872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:36.243476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48691a1f-ee95-488e-aa14-879765e7c872 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:36.249472 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 639/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:36 2022] GET /identity/v3/role_assignments?user.id=0aa69689b82d4994beac3b698d40c37f&scope.project.id=5f10d3e6c5c24ebabb0c7cde9794c47d&role.id=2fc9bc07a4f843ec8270a6b097a81ec1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:38.299114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2512cb-d3bc-4175-9e00-eadb5cc53ee3 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:38.299737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2512cb-d3bc-4175-9e00-eadb5cc53ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:38.299737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2512cb-d3bc-4175-9e00-eadb5cc53ee3 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:38.301143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 649/1288] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:38.306673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3904b-fa8f-4106-ad48-577dd9649402 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:38.307168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3904b-fa8f-4106-ad48-577dd9649402 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:38.307281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3904b-fa8f-4106-ad48-577dd9649402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:38.327522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-07e3904b-fa8f-4106-ad48-577dd9649402 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:38.328750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-07e3904b-fa8f-4106-ad48-577dd9649402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:38.360186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:38.397515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 640/1289] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:38.421637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2512cb-d3bc-4175-9e00-eadb5cc53ee3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:38.535976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2512cb-d3bc-4175-9e00-eadb5cc53ee3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:38.548043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:38.571416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50842dc4-003d-4b48-a587-fd1fecda3230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:38.572150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50842dc4-003d-4b48-a587-fd1fecda3230 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:38.572493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50842dc4-003d-4b48-a587-fd1fecda3230 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:38.572818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50842dc4-003d-4b48-a587-fd1fecda3230 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:38.573607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50842dc4-003d-4b48-a587-fd1fecda3230 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:38.575111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50842dc4-003d-4b48-a587-fd1fecda3230 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-50842dc4-003d-4b48-a587-fd1fecda3230 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:38.584266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:38.585399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:38.586304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 650/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Mon Jul 25 22:48:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:38.592697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3904b-fa8f-4106-ad48-577dd9649402 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:38.693531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3904b-fa8f-4106-ad48-577dd9649402 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:38.729148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83509458-9c8c-477f-8dc9-30f16ecedd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:38.730282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83509458-9c8c-477f-8dc9-30f16ecedd17 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:38.730560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83509458-9c8c-477f-8dc9-30f16ecedd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:38.730839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83509458-9c8c-477f-8dc9-30f16ecedd17 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:38.731516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83509458-9c8c-477f-8dc9-30f16ecedd17 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:38.731822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83509458-9c8c-477f-8dc9-30f16ecedd17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:38.733228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83509458-9c8c-477f-8dc9-30f16ecedd17 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:38.738273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 641/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Mon Jul 25 22:48:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:38.745450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50842dc4-003d-4b48-a587-fd1fecda3230 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:38.848269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50842dc4-003d-4b48-a587-fd1fecda3230 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:38.883795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350bed8-1d77-4123-adc6-b9076a7b01fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:38.888117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350bed8-1d77-4123-adc6-b9076a7b01fd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:38.888117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350bed8-1d77-4123-adc6-b9076a7b01fd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:38.888117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350bed8-1d77-4123-adc6-b9076a7b01fd None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:38.888117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350bed8-1d77-4123-adc6-b9076a7b01fd None admin] RBAC: Adding query filter params (type=placement) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:38.888117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350bed8-1d77-4123-adc6-b9076a7b01fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:38.888117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350bed8-1d77-4123-adc6-b9076a7b01fd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:38.891767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 651/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Mon Jul 25 22:48:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:40.916549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42cfc-c7d7-4559-802b-264c7043be26 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:40.917137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42cfc-c7d7-4559-802b-264c7043be26 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:40.917137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42cfc-c7d7-4559-802b-264c7043be26 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:40.918876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 642/1293] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:40.924352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9826c1-deeb-4ffc-bc4e-425658d9f6be None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:40.924784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9826c1-deeb-4ffc-bc4e-425658d9f6be None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:40.925041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9826c1-deeb-4ffc-bc4e-425658d9f6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:40.943323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ff9826c1-deeb-4ffc-bc4e-425658d9f6be None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:40.944537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ff9826c1-deeb-4ffc-bc4e-425658d9f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:40.976036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:41.013478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 652/1294] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:41.036868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb42cfc-c7d7-4559-802b-264c7043be26 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:41.069278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:41.138902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb42cfc-c7d7-4559-802b-264c7043be26 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:41.173811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36c22e-cbde-4ad0-9028-5f9b1ee15d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:41.174665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36c22e-cbde-4ad0-9028-5f9b1ee15d5e None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:41.174764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36c22e-cbde-4ad0-9028-5f9b1ee15d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:41.174982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36c22e-cbde-4ad0-9028-5f9b1ee15d5e None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:41.175663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36c22e-cbde-4ad0-9028-5f9b1ee15d5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:41.177027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36c22e-cbde-4ad0-9028-5f9b1ee15d5e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:41.269011 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 643/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Mon Jul 25 22:48:41 2022] POST /identity/v3/services => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:43.343408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50165dde-465e-4ce3-8bfe-be8a40eb873f None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.343905 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50165dde-465e-4ce3-8bfe-be8a40eb873f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.343905 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50165dde-465e-4ce3-8bfe-be8a40eb873f None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.345269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 653/1296] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:43.350465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42912d8d-1510-4b49-bd31-fe17793663a4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.350871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42912d8d-1510-4b49-bd31-fe17793663a4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.351011 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42912d8d-1510-4b49-bd31-fe17793663a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.370129 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-42912d8d-1510-4b49-bd31-fe17793663a4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:43.372087 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-42912d8d-1510-4b49-bd31-fe17793663a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:43.446718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 644/1297] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:43.469479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50165dde-465e-4ce3-8bfe-be8a40eb873f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:43.571361 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50165dde-465e-4ce3-8bfe-be8a40eb873f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:43.610702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c99a1-eb04-45ad-a8d3-c5aae8e04faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:43.613370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c99a1-eb04-45ad-a8d3-c5aae8e04faf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.613370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c99a1-eb04-45ad-a8d3-c5aae8e04faf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.613370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c99a1-eb04-45ad-a8d3-c5aae8e04faf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.613370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c99a1-eb04-45ad-a8d3-c5aae8e04faf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:43.613984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c99a1-eb04-45ad-a8d3-c5aae8e04faf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f57c99a1-eb04-45ad-a8d3-c5aae8e04faf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:43.623988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:43.625296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:43.626544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 654/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Mon Jul 25 22:48:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:43.631607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42912d8d-1510-4b49-bd31-fe17793663a4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:43.651012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:43.740198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42912d8d-1510-4b49-bd31-fe17793663a4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:43.775473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fba137-012b-453c-b27b-e7018ae037d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:43.776096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fba137-012b-453c-b27b-e7018ae037d0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.776909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fba137-012b-453c-b27b-e7018ae037d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.777219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fba137-012b-453c-b27b-e7018ae037d0 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.777901 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fba137-012b-453c-b27b-e7018ae037d0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:43.778202 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fba137-012b-453c-b27b-e7018ae037d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:43.779589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fba137-012b-453c-b27b-e7018ae037d0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:43.784920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 645/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Mon Jul 25 22:48:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:43.793320 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c99a1-eb04-45ad-a8d3-c5aae8e04faf None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:43.825926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:43.896850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c99a1-eb04-45ad-a8d3-c5aae8e04faf None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:43.932630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac3bce-0a57-4f15-8134-48515f8955a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:43.933440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac3bce-0a57-4f15-8134-48515f8955a7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.933722 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac3bce-0a57-4f15-8134-48515f8955a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.933994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac3bce-0a57-4f15-8134-48515f8955a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.934752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac3bce-0a57-4f15-8134-48515f8955a7 None admin] RBAC: Adding query filter params (interface=public, service_id=229be338fbea49cfb89dc7b24a446c23, region_id=RegionOne) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:43.935061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac3bce-0a57-4f15-8134-48515f8955a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:43.936438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac3bce-0a57-4f15-8134-48515f8955a7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:43.941732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 655/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Mon Jul 25 22:48:43 2022] GET /identity/v3/endpoints?service_id=229be338fbea49cfb89dc7b24a446c23&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:43.947483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fba137-012b-453c-b27b-e7018ae037d0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:44.033234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:44.051535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fba137-012b-453c-b27b-e7018ae037d0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:44.087197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e02d6-8810-4be0-a0d3-f04f619e2353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:44.087804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e02d6-8810-4be0-a0d3-f04f619e2353 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:44.088086 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e02d6-8810-4be0-a0d3-f04f619e2353 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:44.088360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e02d6-8810-4be0-a0d3-f04f619e2353 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:44.089663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e02d6-8810-4be0-a0d3-f04f619e2353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:44.091492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e02d6-8810-4be0-a0d3-f04f619e2353 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:44.098417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 646/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Mon Jul 25 22:48:43 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:48:46.170228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bda85-4763-45b5-9fc3-bc6c54f09ef3 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.170986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bda85-4763-45b5-9fc3-bc6c54f09ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.170986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bda85-4763-45b5-9fc3-bc6c54f09ef3 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.172291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 656/1302] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:46.177562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9976e-e417-4e63-8da4-433100ac89fb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.178138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9976e-e417-4e63-8da4-433100ac89fb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.178138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9976e-e417-4e63-8da4-433100ac89fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.196373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5ef9976e-e417-4e63-8da4-433100ac89fb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:46.197687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5ef9976e-e417-4e63-8da4-433100ac89fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:46.265396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 647/1303] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:46.288664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bda85-4763-45b5-9fc3-bc6c54f09ef3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.385004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:46.392526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bda85-4763-45b5-9fc3-bc6c54f09ef3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.427367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18812-13b1-4f4c-ac00-f985e01dddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.427936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18812-13b1-4f4c-ac00-f985e01dddd2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.428217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18812-13b1-4f4c-ac00-f985e01dddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.428487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18812-13b1-4f4c-ac00-f985e01dddd2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.429110 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a18812-13b1-4f4c-ac00-f985e01dddd2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.430503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a18812-13b1-4f4c-ac00-f985e01dddd2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f6a18812-13b1-4f4c-ac00-f985e01dddd2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:46.440023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:46.442929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jul 25 22:48:46.444016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 657/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Mon Jul 25 22:48:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:46.447656 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9976e-e417-4e63-8da4-433100ac89fb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.523552 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:46.548449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9976e-e417-4e63-8da4-433100ac89fb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.584135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1808c26-2e98-41f7-8ea2-88ee860660ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.584746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1808c26-2e98-41f7-8ea2-88ee860660ae None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.585030 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1808c26-2e98-41f7-8ea2-88ee860660ae None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.585341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1808c26-2e98-41f7-8ea2-88ee860660ae None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.586017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1808c26-2e98-41f7-8ea2-88ee860660ae None admin] RBAC: Adding query filter params (name=placement) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:46.586341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1808c26-2e98-41f7-8ea2-88ee860660ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.587732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1808c26-2e98-41f7-8ea2-88ee860660ae None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.593274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 648/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Mon Jul 25 22:48:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:46.599358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18812-13b1-4f4c-ac00-f985e01dddd2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.699739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18812-13b1-4f4c-ac00-f985e01dddd2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.735025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f7a0b-4a90-47e1-8fdd-7e5745fe482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.735644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f7a0b-4a90-47e1-8fdd-7e5745fe482e None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.735922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f7a0b-4a90-47e1-8fdd-7e5745fe482e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.736198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f7a0b-4a90-47e1-8fdd-7e5745fe482e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.736918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f7a0b-4a90-47e1-8fdd-7e5745fe482e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.738325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f7a0b-4a90-47e1-8fdd-7e5745fe482e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.800675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 658/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 22:48:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:56.590051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=30 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:56.795700 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:53.895721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c1606-a34a-4f83-8341-3ea41528648b None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:53.896598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c1606-a34a-4f83-8341-3ea41528648b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:53.896598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c1606-a34a-4f83-8341-3ea41528648b None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:53.903530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5735e-2584-4764-8ce8-f8db6cd4905e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:53.904334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5735e-2584-4764-8ce8-f8db6cd4905e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:53.904334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5735e-2584-4764-8ce8-f8db6cd4905e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:53.909418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 649/1307] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:54:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:54.007980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-54a5735e-2584-4764-8ce8-f8db6cd4905e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:54.009301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-54a5735e-2584-4764-8ce8-f8db6cd4905e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:54.180601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 659/1308] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:54.251396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611f0f8-4f9a-49ff-b1cb-03da9487d9ce None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:54.251680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611f0f8-4f9a-49ff-b1cb-03da9487d9ce None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:54.251987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611f0f8-4f9a-49ff-b1cb-03da9487d9ce None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:54.254356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 650/1309] 10.222.0.55 () {54 vars in 965 bytes} [Mon Jul 25 22:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:54.261202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5427e7-c619-4a60-9807-3d62032f61af None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:54.261586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5427e7-c619-4a60-9807-3d62032f61af None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:54.261975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5427e7-c619-4a60-9807-3d62032f61af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:54.388951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7f5427e7-c619-4a60-9807-3d62032f61af None None] MFA Rules not processed for user `aa8cd52bd9f24f7d8ed93943aaaeaa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:54.391095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7f5427e7-c619-4a60-9807-3d62032f61af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:54.416871 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:54.510124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 660/1310] 10.222.0.55 () {58 vars in 1062 bytes} [Mon Jul 25 22:54:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:54.519991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611f0f8-4f9a-49ff-b1cb-03da9487d9ce None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:54.521831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2611f0f8-4f9a-49ff-b1cb-03da9487d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:54.774730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611f0f8-4f9a-49ff-b1cb-03da9487d9ce None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:55.015439 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6b405-09ed-4790-9de8-45e2441e7ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:55.017104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6b405-09ed-4790-9de8-45e2441e7ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:55.018863 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6b405-09ed-4790-9de8-45e2441e7ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:55.020280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6b405-09ed-4790-9de8-45e2441e7ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:55.023315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-28a6b405-09ed-4790-9de8-45e2441e7ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:55.137740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:55.298035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6b405-09ed-4790-9de8-45e2441e7ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:55.299478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6b405-09ed-4790-9de8-45e2441e7ea5 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:55.328390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 651/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:58.179136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85faaa9-d8d1-44e7-8390-1a15fe57cf60 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:58.179652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85faaa9-d8d1-44e7-8390-1a15fe57cf60 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:58.180024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85faaa9-d8d1-44e7-8390-1a15fe57cf60 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:58.182658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 661/1312] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:54:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:58.190077 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d085-6dcd-46c3-a7cb-a18e21573d31 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:58.190633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d085-6dcd-46c3-a7cb-a18e21573d31 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:58.191002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d085-6dcd-46c3-a7cb-a18e21573d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:58.284946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-57d6d085-6dcd-46c3-a7cb-a18e21573d31 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:58.286236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-57d6d085-6dcd-46c3-a7cb-a18e21573d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:58.411522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 652/1313] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:58.452875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85faaa9-d8d1-44e7-8390-1a15fe57cf60 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:58.456066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f85faaa9-d8d1-44e7-8390-1a15fe57cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:58.600646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85faaa9-d8d1-44e7-8390-1a15fe57cf60 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:58.680548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:58.683328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef308c-72af-46ad-9a43-ac5227eb2c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:58.684070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef308c-72af-46ad-9a43-ac5227eb2c45 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:58.684446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef308c-72af-46ad-9a43-ac5227eb2c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:58.684816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef308c-72af-46ad-9a43-ac5227eb2c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:58.687488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-daef308c-72af-46ad-9a43-ac5227eb2c45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:58.813810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef308c-72af-46ad-9a43-ac5227eb2c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:58.815216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef308c-72af-46ad-9a43-ac5227eb2c45 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:58.835949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 662/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:01.550280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bae61-78ea-461c-9a7b-99c5a29bdb89 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.550884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bae61-78ea-461c-9a7b-99c5a29bdb89 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.550884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bae61-78ea-461c-9a7b-99c5a29bdb89 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.552612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 653/1315] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:01.558889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74110-10ff-4f4c-8ff1-1a7a09586a0b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.559472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74110-10ff-4f4c-8ff1-1a7a09586a0b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.559472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74110-10ff-4f4c-8ff1-1a7a09586a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.644982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a8b74110-10ff-4f4c-8ff1-1a7a09586a0b None None] MFA Rules not processed for user `94827b7fc9d34f2680ea4bbd23e01217`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:01.646319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a8b74110-10ff-4f4c-8ff1-1a7a09586a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:01.712472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:01.764022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 663/1316] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:01.820011 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaee29-9e74-4708-8750-eaf150f0bab5 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.820233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaee29-9e74-4708-8750-eaf150f0bab5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.820499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaee29-9e74-4708-8750-eaf150f0bab5 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.822064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 654/1317] 10.222.0.55 () {54 vars in 965 bytes} [Mon Jul 25 22:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:01.828499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dd64e-64d2-406f-8bb5-f03147b3fe97 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.828812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dd64e-64d2-406f-8bb5-f03147b3fe97 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.829086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dd64e-64d2-406f-8bb5-f03147b3fe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.947598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-584dd64e-64d2-406f-8bb5-f03147b3fe97 None None] MFA Rules not processed for user `aa8cd52bd9f24f7d8ed93943aaaeaa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:01.948820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-584dd64e-64d2-406f-8bb5-f03147b3fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:02.034477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 664/1318] 10.222.0.55 () {58 vars in 1062 bytes} [Mon Jul 25 22:55:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:02.044112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaee29-9e74-4708-8750-eaf150f0bab5 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:02.049928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-52eaee29-9e74-4708-8750-eaf150f0bab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:02.060415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:02.165636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaee29-9e74-4708-8750-eaf150f0bab5 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:02.248321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcaaf6-f899-4724-8570-63caf7b50ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:02.250410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcaaf6-f899-4724-8570-63caf7b50ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.250617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcaaf6-f899-4724-8570-63caf7b50ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.250804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcaaf6-f899-4724-8570-63caf7b50ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.252534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e8fcaaf6-f899-4724-8570-63caf7b50ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:02.325588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:02.379903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcaaf6-f899-4724-8570-63caf7b50ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:02.381390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcaaf6-f899-4724-8570-63caf7b50ac9 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:02.400815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 655/1319] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:05.853591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8abcb-7375-4b84-ae88-509cf91aee92 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:05.854363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8abcb-7375-4b84-ae88-509cf91aee92 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:05.854363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8abcb-7375-4b84-ae88-509cf91aee92 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:05.855524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 665/1320] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:05.861841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b849fbd-9b0d-4134-8fe8-9f549d409198 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:05.862332 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b849fbd-9b0d-4134-8fe8-9f549d409198 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:05.862439 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b849fbd-9b0d-4134-8fe8-9f549d409198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:05.935658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0b849fbd-9b0d-4134-8fe8-9f549d409198 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:05.937806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0b849fbd-9b0d-4134-8fe8-9f549d409198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:06.047125 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 656/1321] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:06.087467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8abcb-7375-4b84-ae88-509cf91aee92 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:06.089025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1de8abcb-7375-4b84-ae88-509cf91aee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:06.174175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:06.250928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8abcb-7375-4b84-ae88-509cf91aee92 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:06.347077 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb7f29-1e9e-40eb-87e7-c0837e8a811d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:06.347761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7f29-1e9e-40eb-87e7-c0837e8a811d service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:06.348079 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7f29-1e9e-40eb-87e7-c0837e8a811d service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:06.348388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7f29-1e9e-40eb-87e7-c0837e8a811d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:06.350295 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8acb7f29-1e9e-40eb-87e7-c0837e8a811d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:06.467769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:06.482814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb7f29-1e9e-40eb-87e7-c0837e8a811d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:06.485346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb7f29-1e9e-40eb-87e7-c0837e8a811d service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:06.507633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 666/1322] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:10.070167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bdeba-85a3-475b-835c-f6e1c8339a8a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:10.070973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bdeba-85a3-475b-835c-f6e1c8339a8a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:10.070973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bdeba-85a3-475b-835c-f6e1c8339a8a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:10.072088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 657/1323] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:10.079157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b5bae-5203-43ae-a7b1-7d7ceb28afd9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:10.079715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b5bae-5203-43ae-a7b1-7d7ceb28afd9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:10.080163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b5bae-5203-43ae-a7b1-7d7ceb28afd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:10.175898 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-af2b5bae-5203-43ae-a7b1-7d7ceb28afd9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:10.177509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-af2b5bae-5203-43ae-a7b1-7d7ceb28afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:10.302027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 667/1324] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:10.342504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bdeba-85a3-475b-835c-f6e1c8339a8a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:10.344419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b98bdeba-85a3-475b-835c-f6e1c8339a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:10.368309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:10.479557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bdeba-85a3-475b-835c-f6e1c8339a8a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:10.598340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8b2d5-15aa-4ba6-b34b-86bacb9ef3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:10.599269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b2d5-15aa-4ba6-b34b-86bacb9ef3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:10.599693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b2d5-15aa-4ba6-b34b-86bacb9ef3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:10.600088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b2d5-15aa-4ba6-b34b-86bacb9ef3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:10.603124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4ec8b2d5-15aa-4ba6-b34b-86bacb9ef3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:10.702075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:10.754682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8b2d5-15aa-4ba6-b34b-86bacb9ef3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:10.756268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8b2d5-15aa-4ba6-b34b-86bacb9ef3f8 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:10.784340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 658/1325] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:12.983430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec250b-62b3-4194-abdd-52c9d3476638 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:12.984253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec250b-62b3-4194-abdd-52c9d3476638 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:12.984406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec250b-62b3-4194-abdd-52c9d3476638 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:12.986968 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 668/1326] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:12.995780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7489b-07ec-426f-ae90-5975d7c9e7cf None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:12.996638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7489b-07ec-426f-ae90-5975d7c9e7cf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:12.996638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7489b-07ec-426f-ae90-5975d7c9e7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:13.110296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f1d7489b-07ec-426f-ae90-5975d7c9e7cf None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:13.112222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f1d7489b-07ec-426f-ae90-5975d7c9e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:13.314438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 659/1327] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:13.355069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec250b-62b3-4194-abdd-52c9d3476638 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:13.359148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bfec250b-62b3-4194-abdd-52c9d3476638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:13.449777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:13.509336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec250b-62b3-4194-abdd-52c9d3476638 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:13.659541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b666ef-1581-4dfb-a1a6-008064bf647f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:13.660333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b666ef-1581-4dfb-a1a6-008064bf647f service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:13.660753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b666ef-1581-4dfb-a1a6-008064bf647f service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:13.661154 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b666ef-1581-4dfb-a1a6-008064bf647f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:13.663483 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-76b666ef-1581-4dfb-a1a6-008064bf647f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:13.898989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:13.900859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b666ef-1581-4dfb-a1a6-008064bf647f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:13.902514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b666ef-1581-4dfb-a1a6-008064bf647f service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:13.932545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 669/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:16.228044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53cad6-41b7-4daa-8d87-700e818da90c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:16.228579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53cad6-41b7-4daa-8d87-700e818da90c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:16.228579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53cad6-41b7-4daa-8d87-700e818da90c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:16.231024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 660/1329] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:16.242365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e17d3-96ea-4e54-bbda-7c61992fb412 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:16.242924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e17d3-96ea-4e54-bbda-7c61992fb412 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:16.243247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e17d3-96ea-4e54-bbda-7c61992fb412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:16.335677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-aa2e17d3-96ea-4e54-bbda-7c61992fb412 None None] MFA Rules not processed for user `94827b7fc9d34f2680ea4bbd23e01217`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:16.336925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-aa2e17d3-96ea-4e54-bbda-7c61992fb412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:16.476259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 670/1330] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:16.519401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53cad6-41b7-4daa-8d87-700e818da90c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:16.520977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0f53cad6-41b7-4daa-8d87-700e818da90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:16.559705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:16.679510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53cad6-41b7-4daa-8d87-700e818da90c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:16.782516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ade1c-5ff8-44f9-bc1e-9d7e5201705e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:16.783055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ade1c-5ff8-44f9-bc1e-9d7e5201705e service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:16.783331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ade1c-5ff8-44f9-bc1e-9d7e5201705e service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:16.783602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ade1c-5ff8-44f9-bc1e-9d7e5201705e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:16.785336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-092ade1c-5ff8-44f9-bc1e-9d7e5201705e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:16.906698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:16.966206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ade1c-5ff8-44f9-bc1e-9d7e5201705e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:16.969530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ade1c-5ff8-44f9-bc1e-9d7e5201705e service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:16.991807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 661/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:19.606125 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349be04-c8ed-4168-ae20-41aa6e1015cb None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:19.606892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349be04-c8ed-4168-ae20-41aa6e1015cb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:19.606892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349be04-c8ed-4168-ae20-41aa6e1015cb None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:19.609270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 671/1332] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:19.615973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab942c-c64d-4e8c-88af-0161fbece47c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:19.616511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab942c-c64d-4e8c-88af-0161fbece47c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:19.616826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab942c-c64d-4e8c-88af-0161fbece47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:19.696977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-30ab942c-c64d-4e8c-88af-0161fbece47c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:19.698251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-30ab942c-c64d-4e8c-88af-0161fbece47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:19.808268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 662/1333] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:19.849112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349be04-c8ed-4168-ae20-41aa6e1015cb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:19.850741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8349be04-c8ed-4168-ae20-41aa6e1015cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:19.932517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:19.971539 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349be04-c8ed-4168-ae20-41aa6e1015cb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:20.055066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe0fd1-b580-4f59-abee-0d312aa3a9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:20.055700 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe0fd1-b580-4f59-abee-0d312aa3a9cb service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:20.055982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe0fd1-b580-4f59-abee-0d312aa3a9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:20.056254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe0fd1-b580-4f59-abee-0d312aa3a9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:20.058002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-94fe0fd1-b580-4f59-abee-0d312aa3a9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:20.181698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe0fd1-b580-4f59-abee-0d312aa3a9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:20.183074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe0fd1-b580-4f59-abee-0d312aa3a9cb service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:20.194842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:20.203740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 672/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:22.413203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb10fd0-f18b-4cbf-989e-afc4e22cd56a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:22.413768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb10fd0-f18b-4cbf-989e-afc4e22cd56a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:22.413768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb10fd0-f18b-4cbf-989e-afc4e22cd56a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:22.415138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 663/1335] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:22.420791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bac5f1-dc71-4110-9140-a706cd46fbfe None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:22.421346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bac5f1-dc71-4110-9140-a706cd46fbfe None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:22.421461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bac5f1-dc71-4110-9140-a706cd46fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:22.491995 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-90bac5f1-dc71-4110-9140-a706cd46fbfe None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:22.493283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-90bac5f1-dc71-4110-9140-a706cd46fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:22.601538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 673/1336] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:22.643896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb10fd0-f18b-4cbf-989e-afc4e22cd56a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:22.645507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8bb10fd0-f18b-4cbf-989e-afc4e22cd56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:22.689150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:22.774248 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb10fd0-f18b-4cbf-989e-afc4e22cd56a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:22.863663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4bc51-de38-4df1-9df0-7717a137a969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:22.872658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4bc51-de38-4df1-9df0-7717a137a969 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:22.872658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4bc51-de38-4df1-9df0-7717a137a969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:22.872658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4bc51-de38-4df1-9df0-7717a137a969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:22.872658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b4e4bc51-de38-4df1-9df0-7717a137a969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:22.985572 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:23.016749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4bc51-de38-4df1-9df0-7717a137a969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:23.018302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4bc51-de38-4df1-9df0-7717a137a969 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:23.038865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 664/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:25.986575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a370eae-ff41-4c00-9b5c-abe3d0965831 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:25.987122 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a370eae-ff41-4c00-9b5c-abe3d0965831 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:25.987122 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a370eae-ff41-4c00-9b5c-abe3d0965831 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:25.988520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 674/1338] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:25.994240 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3f084-3b3f-4038-b871-7c8a92a86a8a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:25.994718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3f084-3b3f-4038-b871-7c8a92a86a8a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:25.994808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3f084-3b3f-4038-b871-7c8a92a86a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.070529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3ec3f084-3b3f-4038-b871-7c8a92a86a8a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:26.071772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3ec3f084-3b3f-4038-b871-7c8a92a86a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:26.178229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 665/1339] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:26.216619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a370eae-ff41-4c00-9b5c-abe3d0965831 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:26.218247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6a370eae-ff41-4c00-9b5c-abe3d0965831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:26.301531 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:26.334462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a370eae-ff41-4c00-9b5c-abe3d0965831 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:26.417238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df2e4e-4bf3-4787-ae46-f6c38f5d57c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:26.417876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2e4e-4bf3-4787-ae46-f6c38f5d57c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:26.418147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2e4e-4bf3-4787-ae46-f6c38f5d57c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:26.418412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2e4e-4bf3-4787-ae46-f6c38f5d57c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.420713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-97df2e4e-4bf3-4787-ae46-f6c38f5d57c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:26.557179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df2e4e-4bf3-4787-ae46-f6c38f5d57c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:26.558647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df2e4e-4bf3-4787-ae46-f6c38f5d57c4 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:26.580275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 675/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:31.378228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff100b-0b1a-4d74-890f-6f3f6a4ca1db None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:31.379203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff100b-0b1a-4d74-890f-6f3f6a4ca1db None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:31.379203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff100b-0b1a-4d74-890f-6f3f6a4ca1db None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:31.384745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 666/1341] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:31.387258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10674f-ec5f-4b96-abd0-bc3378810cc5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:31.387944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10674f-ec5f-4b96-abd0-bc3378810cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:31.388224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10674f-ec5f-4b96-abd0-bc3378810cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:31.397672 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:31.474106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4a10674f-ec5f-4b96-abd0-bc3378810cc5 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:31.475411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4a10674f-ec5f-4b96-abd0-bc3378810cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:31.633197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 676/1342] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:31.700082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff100b-0b1a-4d74-890f-6f3f6a4ca1db None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:31.703170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d1ff100b-0b1a-4d74-890f-6f3f6a4ca1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:31.768656 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:31.845952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff100b-0b1a-4d74-890f-6f3f6a4ca1db None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:31.956062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6079b8-3405-4f0c-b909-995d2fdd7fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:31.957255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6079b8-3405-4f0c-b909-995d2fdd7fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:31.957836 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6079b8-3405-4f0c-b909-995d2fdd7fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:31.958349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6079b8-3405-4f0c-b909-995d2fdd7fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:31.961728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8f6079b8-3405-4f0c-b909-995d2fdd7fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:32.118856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:32.140843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6079b8-3405-4f0c-b909-995d2fdd7fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:32.143026 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6079b8-3405-4f0c-b909-995d2fdd7fe7 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:32.178914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 667/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:35.414484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b538b-d85d-4a93-9591-8d84e1cb3830 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:35.415259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b538b-d85d-4a93-9591-8d84e1cb3830 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:35.415259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b538b-d85d-4a93-9591-8d84e1cb3830 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:35.416481 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 677/1344] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:35.423900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0e07-9ecf-4898-ba5d-93dc53ab2e8f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:35.424474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0e07-9ecf-4898-ba5d-93dc53ab2e8f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:35.424983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0e07-9ecf-4898-ba5d-93dc53ab2e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:35.510928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3dcb0e07-9ecf-4898-ba5d-93dc53ab2e8f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:35.512138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3dcb0e07-9ecf-4898-ba5d-93dc53ab2e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:35.630505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 668/1345] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:35.672098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b538b-d85d-4a93-9591-8d84e1cb3830 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:35.675269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b50b538b-d85d-4a93-9591-8d84e1cb3830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:35.787081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:35.806796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b538b-d85d-4a93-9591-8d84e1cb3830 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:35.895875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6938d2f-4561-4646-973b-008b6fae3464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:35.899844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938d2f-4561-4646-973b-008b6fae3464 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:35.899844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938d2f-4561-4646-973b-008b6fae3464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:35.899844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938d2f-4561-4646-973b-008b6fae3464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:35.899844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f6938d2f-4561-4646-973b-008b6fae3464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:36.043175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6938d2f-4561-4646-973b-008b6fae3464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:36.045301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6938d2f-4561-4646-973b-008b6fae3464 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:36.068085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 678/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:41.689574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ecaa-2ef9-4616-afae-d588b17dc73f None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:41.690150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ecaa-2ef9-4616-afae-d588b17dc73f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:41.690150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ecaa-2ef9-4616-afae-d588b17dc73f None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:41.691560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 669/1347] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:41.697946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554cf28-715c-4e38-a283-b01ce673c154 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:41.698522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554cf28-715c-4e38-a283-b01ce673c154 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:41.698522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554cf28-715c-4e38-a283-b01ce673c154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:41.719311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:41.790572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6554cf28-715c-4e38-a283-b01ce673c154 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:41.792728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6554cf28-715c-4e38-a283-b01ce673c154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:41.921967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 679/1348] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:41.961893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ecaa-2ef9-4616-afae-d588b17dc73f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:41.963460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f274ecaa-2ef9-4616-afae-d588b17dc73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:42.037538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:42.097746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ecaa-2ef9-4616-afae-d588b17dc73f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:42.192026 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762bd90-5d8b-481c-b518-21a5d1722a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:42.192578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762bd90-5d8b-481c-b518-21a5d1722a93 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:42.192861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762bd90-5d8b-481c-b518-21a5d1722a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:42.193166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762bd90-5d8b-481c-b518-21a5d1722a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:42.194895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4762bd90-5d8b-481c-b518-21a5d1722a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:42.344905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:42.349610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762bd90-5d8b-481c-b518-21a5d1722a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:42.351300 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762bd90-5d8b-481c-b518-21a5d1722a93 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:42.381678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 670/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:48.072459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8245d-ff4d-4860-8961-f6a4b4cb25a4 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:48.074207 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8245d-ff4d-4860-8961-f6a4b4cb25a4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:48.074388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8245d-ff4d-4860-8961-f6a4b4cb25a4 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:48.078171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 680/1350] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 22:55:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:48.083799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98acd5c-2338-4ac9-8ab6-c6fb683d4873 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:48.083799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98acd5c-2338-4ac9-8ab6-c6fb683d4873 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:48.083799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98acd5c-2338-4ac9-8ab6-c6fb683d4873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:48.248032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f98acd5c-2338-4ac9-8ab6-c6fb683d4873 None None] MFA Rules not processed for user `0aa69689b82d4994beac3b698d40c37f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:48.248032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f98acd5c-2338-4ac9-8ab6-c6fb683d4873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:48.461391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 671/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 22:55:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:51.919948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=59 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:54.058122 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767f048-68df-46d6-ae6a-4abd956f0763 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:54.059143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767f048-68df-46d6-ae6a-4abd956f0763 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:54.059143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767f048-68df-46d6-ae6a-4abd956f0763 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:54.062581 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 681/1352] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 22:55:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:54.069145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a1dc-0726-4e01-ab84-c492bfc046e7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:54.069876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a1dc-0726-4e01-ab84-c492bfc046e7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:54.069876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a1dc-0726-4e01-ab84-c492bfc046e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:54.137140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:54.166820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fcb2a1dc-0726-4e01-ab84-c492bfc046e7 None None] MFA Rules not processed for user `0aa69689b82d4994beac3b698d40c37f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:54.168899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fcb2a1dc-0726-4e01-ab84-c492bfc046e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:54.361006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 672/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 22:55:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:56.052101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0761d-e7dc-4fb1-a32b-d301e1b1fe16 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.052939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0761d-e7dc-4fb1-a32b-d301e1b1fe16 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.052939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0761d-e7dc-4fb1-a32b-d301e1b1fe16 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.055622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 682/1354] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 22:55:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:56.062896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42f155-dd38-4454-b110-03a235162924 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.063708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42f155-dd38-4454-b110-03a235162924 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.063864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42f155-dd38-4454-b110-03a235162924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.176705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6c42f155-dd38-4454-b110-03a235162924 None None] MFA Rules not processed for user `0aa69689b82d4994beac3b698d40c37f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:56.178820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6c42f155-dd38-4454-b110-03a235162924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:56.249776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:56.353055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 673/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 22:55:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:00.166322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62381d37-f942-43bd-9d8b-7c82b4b1c176 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:00.167024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62381d37-f942-43bd-9d8b-7c82b4b1c176 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:00.167237 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62381d37-f942-43bd-9d8b-7c82b4b1c176 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:00.170104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 683/1356] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:00.176957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98acdd0-4b36-4134-98d3-b7fe7f472206 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:00.177763 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98acdd0-4b36-4134-98d3-b7fe7f472206 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:00.177763 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98acdd0-4b36-4134-98d3-b7fe7f472206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:00.310071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a98acdd0-4b36-4134-98d3-b7fe7f472206 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:00.312481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a98acdd0-4b36-4134-98d3-b7fe7f472206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:00.512944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 674/1357] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:00.619494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f25a2-2353-428e-bded-1259ad285336 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:00.620394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f25a2-2353-428e-bded-1259ad285336 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:00.621330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f25a2-2353-428e-bded-1259ad285336 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:00.626133 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 684/1358] 10.222.0.55 () {54 vars in 962 bytes} [Mon Jul 25 22:56:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:00.641063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab1558-9dc1-4c87-bb28-97599fa6d9cb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:00.642396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab1558-9dc1-4c87-bb28-97599fa6d9cb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:00.643433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab1558-9dc1-4c87-bb28-97599fa6d9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:00.680670 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:00.800806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-22ab1558-9dc1-4c87-bb28-97599fa6d9cb None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:00.802203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-22ab1558-9dc1-4c87-bb28-97599fa6d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:01.011804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 675/1359] 10.222.0.55 () {58 vars in 1059 bytes} [Mon Jul 25 22:56:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:01.027802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f25a2-2353-428e-bded-1259ad285336 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:01.030873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-526f25a2-2353-428e-bded-1259ad285336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:01.351761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f25a2-2353-428e-bded-1259ad285336 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:01.510782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:01.604407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201a215-a4b7-4ab0-b023-d20d9077f488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:01.605735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201a215-a4b7-4ab0-b023-d20d9077f488 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:01.607331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201a215-a4b7-4ab0-b023-d20d9077f488 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:01.607790 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201a215-a4b7-4ab0-b023-d20d9077f488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:01.610958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6201a215-a4b7-4ab0-b023-d20d9077f488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:01.800585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201a215-a4b7-4ab0-b023-d20d9077f488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:01.802834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201a215-a4b7-4ab0-b023-d20d9077f488 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:01.844161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 685/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:04.502718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ac7f2-3cbb-4a18-b448-8a7efcbc0432 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:04.503497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ac7f2-3cbb-4a18-b448-8a7efcbc0432 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:04.503497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ac7f2-3cbb-4a18-b448-8a7efcbc0432 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:04.504831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 676/1361] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:04.510333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584662-faf0-4d23-9d44-cd1421d37f53 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:04.511152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584662-faf0-4d23-9d44-cd1421d37f53 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:04.511152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584662-faf0-4d23-9d44-cd1421d37f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:04.601635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-fd584662-faf0-4d23-9d44-cd1421d37f53 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:04.603627 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fd584662-faf0-4d23-9d44-cd1421d37f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:04.653649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:04.735545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 686/1362] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:04.790473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ac7f2-3cbb-4a18-b448-8a7efcbc0432 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:04.792131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ee9ac7f2-3cbb-4a18-b448-8a7efcbc0432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:04.958916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:05.065502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ac7f2-3cbb-4a18-b448-8a7efcbc0432 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:05.210239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc8a2-86f1-4805-9d23-849912ca716e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:05.211206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc8a2-86f1-4805-9d23-849912ca716e service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:05.211697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc8a2-86f1-4805-9d23-849912ca716e service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:05.212154 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc8a2-86f1-4805-9d23-849912ca716e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:05.214418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-53fcc8a2-86f1-4805-9d23-849912ca716e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:05.253089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:05.358551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcc8a2-86f1-4805-9d23-849912ca716e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:05.360446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcc8a2-86f1-4805-9d23-849912ca716e service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:05.385335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 677/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:08.141061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214c96-0407-4cf9-962c-05f129342203 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:08.141710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214c96-0407-4cf9-962c-05f129342203 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:08.141710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214c96-0407-4cf9-962c-05f129342203 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:08.142928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 687/1364] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:08.149013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1373c-bb85-4e08-98c5-3b44da7c636d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:08.149565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1373c-bb85-4e08-98c5-3b44da7c636d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:08.149565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1373c-bb85-4e08-98c5-3b44da7c636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:08.229658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f0f1373c-bb85-4e08-98c5-3b44da7c636d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:08.232581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f0f1373c-bb85-4e08-98c5-3b44da7c636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:08.351216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:08.361285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 678/1365] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:08.433314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c729b-7f38-456e-8c3f-f0fb44c4b16e None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:08.434043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c729b-7f38-456e-8c3f-f0fb44c4b16e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:08.434493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c729b-7f38-456e-8c3f-f0fb44c4b16e None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:08.436111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 688/1366] 10.222.0.55 () {54 vars in 962 bytes} [Mon Jul 25 22:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:08.446322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277926-8fee-4eec-82f1-43ba81bcd8e1 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:08.447120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277926-8fee-4eec-82f1-43ba81bcd8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:08.447730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277926-8fee-4eec-82f1-43ba81bcd8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:08.541021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c9277926-8fee-4eec-82f1-43ba81bcd8e1 None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:08.542488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c9277926-8fee-4eec-82f1-43ba81bcd8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:08.710624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 679/1367] 10.222.0.55 () {58 vars in 1059 bytes} [Mon Jul 25 22:56:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:08.719513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c729b-7f38-456e-8c3f-f0fb44c4b16e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:08.721030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c68c729b-7f38-456e-8c3f-f0fb44c4b16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:08.941068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c729b-7f38-456e-8c3f-f0fb44c4b16e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:08.965710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:09.077525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5c266-36ce-4f79-b9b1-6f1610adcd59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:09.078494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5c266-36ce-4f79-b9b1-6f1610adcd59 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:09.078963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5c266-36ce-4f79-b9b1-6f1610adcd59 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:09.079392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5c266-36ce-4f79-b9b1-6f1610adcd59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:09.081331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-29a5c266-36ce-4f79-b9b1-6f1610adcd59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:09.204981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5c266-36ce-4f79-b9b1-6f1610adcd59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:09.206875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5c266-36ce-4f79-b9b1-6f1610adcd59 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:09.247184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 689/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:09.812022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897745-f687-4678-9566-356cfa9fc7fa None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:09.812758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897745-f687-4678-9566-356cfa9fc7fa None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:09.812758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897745-f687-4678-9566-356cfa9fc7fa None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:09.818268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 680/1369] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:09.821296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947210f-ea6d-44da-bc98-ea7caaecfecd None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:09.822080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947210f-ea6d-44da-bc98-ea7caaecfecd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:09.822584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947210f-ea6d-44da-bc98-ea7caaecfecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:09.890459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:09.967298 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9947210f-ea6d-44da-bc98-ea7caaecfecd None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:09.969604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9947210f-ea6d-44da-bc98-ea7caaecfecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:10.162313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 690/1370] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:10.546960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fafc8-8d54-4a1d-a23b-04b18c56c191 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:10.546960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fafc8-8d54-4a1d-a23b-04b18c56c191 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:10.547886 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fafc8-8d54-4a1d-a23b-04b18c56c191 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:10.551124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 681/1371] 10.222.0.55 () {54 vars in 964 bytes} [Mon Jul 25 22:56:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:10.556839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c01fe-2cba-47dd-9e07-7e631c67dda5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:10.557412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c01fe-2cba-47dd-9e07-7e631c67dda5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:10.557668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c01fe-2cba-47dd-9e07-7e631c67dda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:10.652957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-774c01fe-2cba-47dd-9e07-7e631c67dda5 None None] MFA Rules not processed for user `3ccf6c1a5c044294a8eb83c877a6316e`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:10.653948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-774c01fe-2cba-47dd-9e07-7e631c67dda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:10.736728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:10.788378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 691/1372] 10.222.0.55 () {58 vars in 1061 bytes} [Mon Jul 25 22:56:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:10.796599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fafc8-8d54-4a1d-a23b-04b18c56c191 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:10.798399 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-863fafc8-8d54-4a1d-a23b-04b18c56c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:10.862243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:10.924938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fafc8-8d54-4a1d-a23b-04b18c56c191 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:11.024452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b0e08-151c-4d95-9dae-09fd671110fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:11.025022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0e08-151c-4d95-9dae-09fd671110fe service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:11.025535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0e08-151c-4d95-9dae-09fd671110fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:11.025817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0e08-151c-4d95-9dae-09fd671110fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:11.028634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f80b0e08-151c-4d95-9dae-09fd671110fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:11.146733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:11.163244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b0e08-151c-4d95-9dae-09fd671110fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:11.164726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b0e08-151c-4d95-9dae-09fd671110fe service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:11.190954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 682/1373] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:11.689425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ec69-718e-4985-a38f-8f772a678c77 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:11.690094 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ec69-718e-4985-a38f-8f772a678c77 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:11.690094 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ec69-718e-4985-a38f-8f772a678c77 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:11.691662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 692/1374] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:11.702544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9dead-7d4a-4baa-898b-460caa1ef2ca None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:11.702832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9dead-7d4a-4baa-898b-460caa1ef2ca None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:11.703111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9dead-7d4a-4baa-898b-460caa1ef2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:11.807340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-cee9dead-7d4a-4baa-898b-460caa1ef2ca None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:11.808660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cee9dead-7d4a-4baa-898b-460caa1ef2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:11.948085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 683/1375] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:11.995382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37ec69-718e-4985-a38f-8f772a678c77 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:11.997590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5a37ec69-718e-4985-a38f-8f772a678c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:12.170913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37ec69-718e-4985-a38f-8f772a678c77 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:12.242032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:12.310248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638902d-daaf-439a-9fe8-d3d2318449cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:12.311184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638902d-daaf-439a-9fe8-d3d2318449cf service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:12.311595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638902d-daaf-439a-9fe8-d3d2318449cf service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:12.312045 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638902d-daaf-439a-9fe8-d3d2318449cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:12.315007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2638902d-daaf-439a-9fe8-d3d2318449cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:12.417977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638902d-daaf-439a-9fe8-d3d2318449cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:12.420279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638902d-daaf-439a-9fe8-d3d2318449cf service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:12.440943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 693/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:14.732825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf46b3-d2e4-4522-8058-a96eeeb0a8d4 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:14.733392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf46b3-d2e4-4522-8058-a96eeeb0a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:14.733857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf46b3-d2e4-4522-8058-a96eeeb0a8d4 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:14.736381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 684/1377] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:14.744247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52184f3-022c-4a8d-b76a-76e12d2f4e31 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:14.744776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52184f3-022c-4a8d-b76a-76e12d2f4e31 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:14.744776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52184f3-022c-4a8d-b76a-76e12d2f4e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:14.856587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a52184f3-022c-4a8d-b76a-76e12d2f4e31 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:14.858635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a52184f3-022c-4a8d-b76a-76e12d2f4e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:14.870340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:15.016814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 694/1378] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:15.064793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf46b3-d2e4-4522-8058-a96eeeb0a8d4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:15.066543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-82cf46b3-d2e4-4522-8058-a96eeeb0a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:15.169820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:15.330881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf46b3-d2e4-4522-8058-a96eeeb0a8d4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:15.515818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa5553-c3f2-41b5-bd6b-36a183e14b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:15.516750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa5553-c3f2-41b5-bd6b-36a183e14b26 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:15.517247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa5553-c3f2-41b5-bd6b-36a183e14b26 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:15.517695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa5553-c3f2-41b5-bd6b-36a183e14b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:15.519689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8eaa5553-c3f2-41b5-bd6b-36a183e14b26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:15.548077 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:15.675687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa5553-c3f2-41b5-bd6b-36a183e14b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:15.679613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa5553-c3f2-41b5-bd6b-36a183e14b26 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:15.723022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 685/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:18.265192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329cdb-fd8f-4fef-ba48-fef5ac1a9009 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:18.265740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329cdb-fd8f-4fef-ba48-fef5ac1a9009 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:18.265740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329cdb-fd8f-4fef-ba48-fef5ac1a9009 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:18.267152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 695/1380] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:18.272569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95244e17-4910-4ef8-9a2f-0d8ad432d685 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:18.273250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95244e17-4910-4ef8-9a2f-0d8ad432d685 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:18.273250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95244e17-4910-4ef8-9a2f-0d8ad432d685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:18.355911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-95244e17-4910-4ef8-9a2f-0d8ad432d685 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:18.357367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-95244e17-4910-4ef8-9a2f-0d8ad432d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:18.515587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:18.533212 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 686/1381] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:18.589388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329cdb-fd8f-4fef-ba48-fef5ac1a9009 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:18.592478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-32329cdb-fd8f-4fef-ba48-fef5ac1a9009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:18.775356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:18.789138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329cdb-fd8f-4fef-ba48-fef5ac1a9009 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:18.954941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c628b-5207-4e1f-bef3-2964a4d9265c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:18.955572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c628b-5207-4e1f-bef3-2964a4d9265c service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:18.955856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c628b-5207-4e1f-bef3-2964a4d9265c service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:18.956139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c628b-5207-4e1f-bef3-2964a4d9265c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:18.957849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-305c628b-5207-4e1f-bef3-2964a4d9265c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:19.130589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c628b-5207-4e1f-bef3-2964a4d9265c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:19.132468 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c628b-5207-4e1f-bef3-2964a4d9265c service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:19.147209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:19.160598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 696/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:21.753988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de77e1-a6b4-4463-baae-1911f372a23e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:21.754780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de77e1-a6b4-4463-baae-1911f372a23e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:21.754780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de77e1-a6b4-4463-baae-1911f372a23e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:21.756028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 687/1383] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:21.763866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36725e76-6b57-42e4-b348-ea6035cb7c01 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:21.764396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36725e76-6b57-42e4-b348-ea6035cb7c01 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:21.764396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36725e76-6b57-42e4-b348-ea6035cb7c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:21.873839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-36725e76-6b57-42e4-b348-ea6035cb7c01 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:21.875222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-36725e76-6b57-42e4-b348-ea6035cb7c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:22.011524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 697/1384] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:22.077864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de77e1-a6b4-4463-baae-1911f372a23e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:22.080880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d5de77e1-a6b4-4463-baae-1911f372a23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:22.268875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de77e1-a6b4-4463-baae-1911f372a23e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:22.415154 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:22.498566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280483e8-010e-4c87-9e3c-a7e139519549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:22.499417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280483e8-010e-4c87-9e3c-a7e139519549 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:22.499841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280483e8-010e-4c87-9e3c-a7e139519549 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:22.500292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280483e8-010e-4c87-9e3c-a7e139519549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:22.502700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-280483e8-010e-4c87-9e3c-a7e139519549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:22.643837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280483e8-010e-4c87-9e3c-a7e139519549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:22.645841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280483e8-010e-4c87-9e3c-a7e139519549 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:22.675683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 688/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:25.230607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619b7d-b618-4374-a38b-3a07ed88229c None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:25.231445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619b7d-b618-4374-a38b-3a07ed88229c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:25.231636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619b7d-b618-4374-a38b-3a07ed88229c None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:25.234262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 698/1386] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:25.242938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb3cd-59e1-489b-bea7-423d62899ecb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:25.244210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb3cd-59e1-489b-bea7-423d62899ecb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:25.244210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb3cd-59e1-489b-bea7-423d62899ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:25.338532 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-16beb3cd-59e1-489b-bea7-423d62899ecb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:25.340981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-16beb3cd-59e1-489b-bea7-423d62899ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:25.384768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:25.471351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 689/1387] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:25.528150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5619b7d-b618-4374-a38b-3a07ed88229c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:25.532340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d5619b7d-b618-4374-a38b-3a07ed88229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:25.654182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:25.743719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5619b7d-b618-4374-a38b-3a07ed88229c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:25.911315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c128-0b92-496b-b3da-74591c62a0ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:25.912237 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c128-0b92-496b-b3da-74591c62a0ff service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:25.912622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c128-0b92-496b-b3da-74591c62a0ff service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:25.912970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c128-0b92-496b-b3da-74591c62a0ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:25.915047 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d5c3c128-0b92-496b-b3da-74591c62a0ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:25.965237 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:26.036975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c128-0b92-496b-b3da-74591c62a0ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:26.038726 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c128-0b92-496b-b3da-74591c62a0ff service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:26.073100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 699/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:27.886945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c338-6be2-4198-8d2a-6181cf8bc771 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:27.887517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c338-6be2-4198-8d2a-6181cf8bc771 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:27.887802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c338-6be2-4198-8d2a-6181cf8bc771 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:27.889214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 690/1389] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:27.895304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64c60d-87f1-41fe-be65-c0e334b37927 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:27.895801 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64c60d-87f1-41fe-be65-c0e334b37927 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:27.896139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64c60d-87f1-41fe-be65-c0e334b37927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:27.981015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-fb64c60d-87f1-41fe-be65-c0e334b37927 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:27.982563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fb64c60d-87f1-41fe-be65-c0e334b37927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:28.102043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 700/1390] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:28.172518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3619-d6c3-4f57-ad23-6b1cbf9cd17a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:28.172838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3619-d6c3-4f57-ad23-6b1cbf9cd17a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:28.173286 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3619-d6c3-4f57-ad23-6b1cbf9cd17a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:28.175361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 691/1391] 10.222.0.55 () {54 vars in 966 bytes} [Mon Jul 25 22:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:28.181959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e331f-0c06-4271-afac-9a7e63f04642 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:28.182328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e331f-0c06-4271-afac-9a7e63f04642 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:28.182786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e331f-0c06-4271-afac-9a7e63f04642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:28.210900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:28.290942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1e6e331f-0c06-4271-afac-9a7e63f04642 None None] MFA Rules not processed for user `a911a544e17e4fafb579da66973c431f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:28.292204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1e6e331f-0c06-4271-afac-9a7e63f04642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:28.380085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 701/1392] 10.222.0.55 () {58 vars in 1063 bytes} [Mon Jul 25 22:56:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:28.388742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3619-d6c3-4f57-ad23-6b1cbf9cd17a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:28.391215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e26f3619-d6c3-4f57-ad23-6b1cbf9cd17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:28.496415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b00d4-f46f-4887-9642-0c9e35f0b2c0 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:28.496711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b00d4-f46f-4887-9642-0c9e35f0b2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:28.497204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b00d4-f46f-4887-9642-0c9e35f0b2c0 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:28.498619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 702/1393] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:56:28.506294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d83e7b-0746-4e99-a4da-e0520c7b6cbc None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:28.506815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d83e7b-0746-4e99-a4da-e0520c7b6cbc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:28.507115 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d83e7b-0746-4e99-a4da-e0520c7b6cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:28.526247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3619-d6c3-4f57-ad23-6b1cbf9cd17a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:28.587366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-90d83e7b-0746-4e99-a4da-e0520c7b6cbc None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:28.588735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-90d83e7b-0746-4e99-a4da-e0520c7b6cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:28.595561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:28.615049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3523a1-0472-4519-8065-64ec108539ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a911a544e17e4fafb579da66973c431f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:28.615686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3523a1-0472-4519-8065-64ec108539ea service glance] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:28.615997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3523a1-0472-4519-8065-64ec108539ea service glance] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:28.616536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3523a1-0472-4519-8065-64ec108539ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:28.618269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-dd3523a1-0472-4519-8065-64ec108539ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:28.656396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:28.712054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 703/1394] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:28.759195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d83e7b-0746-4e99-a4da-e0520c7b6cbc None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:28.760389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-90d83e7b-0746-4e99-a4da-e0520c7b6cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:28.773258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3523a1-0472-4519-8065-64ec108539ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:28.774733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3523a1-0472-4519-8065-64ec108539ea service glance] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:28.798969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 692/1395] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:28.903279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d83e7b-0746-4e99-a4da-e0520c7b6cbc None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:28.986070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:29.042445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038011b8-966b-44c8-9694-aecad8ab0742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:29.043137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038011b8-966b-44c8-9694-aecad8ab0742 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:29.043598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038011b8-966b-44c8-9694-aecad8ab0742 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:29.043875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038011b8-966b-44c8-9694-aecad8ab0742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:29.045919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-038011b8-966b-44c8-9694-aecad8ab0742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:29.163196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038011b8-966b-44c8-9694-aecad8ab0742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:29.164831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038011b8-966b-44c8-9694-aecad8ab0742 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:29.188399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 704/1396] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:29.960263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d814d-bd51-4031-9486-9d406a8d29d3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:29.960823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d814d-bd51-4031-9486-9d406a8d29d3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:29.961272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d814d-bd51-4031-9486-9d406a8d29d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:30.060255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-de2d814d-bd51-4031-9486-9d406a8d29d3 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:30.062583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-de2d814d-bd51-4031-9486-9d406a8d29d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:30.130584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:30.209739 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 693/1397] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 22:56:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:30.280005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478103a-614e-47be-88ba-60316faa7135 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:30.281173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478103a-614e-47be-88ba-60316faa7135 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:30.281173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478103a-614e-47be-88ba-60316faa7135 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:30.283841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 705/1398] 10.222.0.55 () {54 vars in 943 bytes} [Mon Jul 25 22:56:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:30.293256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f13b06-2c67-487f-9747-c896afddf297 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:30.293674 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f13b06-2c67-487f-9747-c896afddf297 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:30.294093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f13b06-2c67-487f-9747-c896afddf297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:30.399283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-03f13b06-2c67-487f-9747-c896afddf297 None None] MFA Rules not processed for user `6db67b0bfa2a4c0f84fad07ac144b7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:30.400527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-03f13b06-2c67-487f-9747-c896afddf297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:30.560400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 694/1399] 10.222.0.55 () {58 vars in 1040 bytes} [Mon Jul 25 22:56:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:30.572093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478103a-614e-47be-88ba-60316faa7135 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:30.574956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8478103a-614e-47be-88ba-60316faa7135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:30.709850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:30.796917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478103a-614e-47be-88ba-60316faa7135 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:30.969386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbc4fb-d49d-4b68-bdba-32547c5e5fc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:30.969910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbc4fb-d49d-4b68-bdba-32547c5e5fc0 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:30.970195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbc4fb-d49d-4b68-bdba-32547c5e5fc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:30.970470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbc4fb-d49d-4b68-bdba-32547c5e5fc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:30.972267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6afbc4fb-d49d-4b68-bdba-32547c5e5fc0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:31.059907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:31.087507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbc4fb-d49d-4b68-bdba-32547c5e5fc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:31.089305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbc4fb-d49d-4b68-bdba-32547c5e5fc0 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:31.100831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 706/1400] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 22:56:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:56:31.683941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6497ee0-3209-40bd-926f-dcb7a6e92b99 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:31.684807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6497ee0-3209-40bd-926f-dcb7a6e92b99 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:31.685178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6497ee0-3209-40bd-926f-dcb7a6e92b99 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:31.689446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 695/1401] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:31.693494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd24d-df71-43f5-a016-c924d33f0d15 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:31.694322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd24d-df71-43f5-a016-c924d33f0d15 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:31.694322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd24d-df71-43f5-a016-c924d33f0d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:31.779904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8cfbd24d-df71-43f5-a016-c924d33f0d15 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:31.781106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8cfbd24d-df71-43f5-a016-c924d33f0d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:31.955509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 707/1402] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:32.050200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6497ee0-3209-40bd-926f-dcb7a6e92b99 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:32.052738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f6497ee0-3209-40bd-926f-dcb7a6e92b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:32.082201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:32.295916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6497ee0-3209-40bd-926f-dcb7a6e92b99 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:32.455726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:32.487990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06867982-3bb2-4b71-a77a-905b84d98ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:32.488618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06867982-3bb2-4b71-a77a-905b84d98ba3 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:32.488895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06867982-3bb2-4b71-a77a-905b84d98ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:32.489193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06867982-3bb2-4b71-a77a-905b84d98ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:32.490872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-06867982-3bb2-4b71-a77a-905b84d98ba3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:32.604170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06867982-3bb2-4b71-a77a-905b84d98ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:32.606068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06867982-3bb2-4b71-a77a-905b84d98ba3 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:32.627049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 696/1403] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:35.050618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b5a4-2885-4407-967b-acd2935ec83d None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:35.051137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b5a4-2885-4407-967b-acd2935ec83d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:35.051732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b5a4-2885-4407-967b-acd2935ec83d None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:35.054624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 708/1404] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:56:35.063258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cb50d-c152-4bd1-8923-52d0e01d101b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:35.064257 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cb50d-c152-4bd1-8923-52d0e01d101b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:35.064736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cb50d-c152-4bd1-8923-52d0e01d101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:35.148893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b63cb50d-c152-4bd1-8923-52d0e01d101b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:35.150192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b63cb50d-c152-4bd1-8923-52d0e01d101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:35.214955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:35.429178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 697/1405] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:35.430100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369b5a4-2885-4407-967b-acd2935ec83d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:35.430100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3369b5a4-2885-4407-967b-acd2935ec83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:35.656964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:35.808844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369b5a4-2885-4407-967b-acd2935ec83d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:35.988785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700b3ab-7f45-4d40-833c-47e023e78cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:35.990404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700b3ab-7f45-4d40-833c-47e023e78cb2 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:35.990919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700b3ab-7f45-4d40-833c-47e023e78cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:35.991257 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700b3ab-7f45-4d40-833c-47e023e78cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:35.992965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8700b3ab-7f45-4d40-833c-47e023e78cb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:36.122523 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700b3ab-7f45-4d40-833c-47e023e78cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:36.124571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700b3ab-7f45-4d40-833c-47e023e78cb2 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:36.153862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 709/1406] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:56:36.514213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:39.442330 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428463b-fcd8-4985-8907-9e1cfd2ffa95 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:39.443219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428463b-fcd8-4985-8907-9e1cfd2ffa95 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:39.443219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428463b-fcd8-4985-8907-9e1cfd2ffa95 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:39.444285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 698/1407] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:56:39.452059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66905cb2-9b58-405c-a7d3-5f3cd3af3bfc None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:39.452906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66905cb2-9b58-405c-a7d3-5f3cd3af3bfc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:39.453070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66905cb2-9b58-405c-a7d3-5f3cd3af3bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:39.553927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-66905cb2-9b58-405c-a7d3-5f3cd3af3bfc None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:39.555200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-66905cb2-9b58-405c-a7d3-5f3cd3af3bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:39.678427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:39.687065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 710/1408] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:39.738136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428463b-fcd8-4985-8907-9e1cfd2ffa95 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:39.740599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4428463b-fcd8-4985-8907-9e1cfd2ffa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:40.046918 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428463b-fcd8-4985-8907-9e1cfd2ffa95 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:40.127381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:40.312621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102ae9a-a6f6-4e1b-a907-6f86aa32c4c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:40.313746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102ae9a-a6f6-4e1b-a907-6f86aa32c4c9 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:40.314394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102ae9a-a6f6-4e1b-a907-6f86aa32c4c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:40.314718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102ae9a-a6f6-4e1b-a907-6f86aa32c4c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:40.316838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6102ae9a-a6f6-4e1b-a907-6f86aa32c4c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:40.461002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102ae9a-a6f6-4e1b-a907-6f86aa32c4c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:40.463579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102ae9a-a6f6-4e1b-a907-6f86aa32c4c9 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:40.487219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 699/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:56:49.723889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:50.484499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=83 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:58.040910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a81c-ba18-4d51-8f54-fa5b637946f9 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:58.041574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a81c-ba18-4d51-8f54-fa5b637946f9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:58.042074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a81c-ba18-4d51-8f54-fa5b637946f9 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:58.043731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 711/1410] 10.222.0.55 () {54 vars in 918 bytes} [Mon Jul 25 22:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:58.049946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08bfea-7c80-4411-a01c-4b6ce096a3a4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:58.050569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08bfea-7c80-4411-a01c-4b6ce096a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:58.050569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08bfea-7c80-4411-a01c-4b6ce096a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:58.140347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-be08bfea-7c80-4411-a01c-4b6ce096a3a4 None None] MFA Rules not processed for user `0aa69689b82d4994beac3b698d40c37f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:58.142131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-be08bfea-7c80-4411-a01c-4b6ce096a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:58.277631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 700/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Mon Jul 25 22:56:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:58.295132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d2003-9b11-46db-9694-6f1b4c3596e8 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:58.295417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d2003-9b11-46db-9694-6f1b4c3596e8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:58.295765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d2003-9b11-46db-9694-6f1b4c3596e8 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:58.297194 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 712/1412] 10.222.0.55 () {54 vars in 918 bytes} [Mon Jul 25 22:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:58.304073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fb68b-0bb6-4c0c-be24-e32cea66a379 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:58.304381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fb68b-0bb6-4c0c-be24-e32cea66a379 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:58.304693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fb68b-0bb6-4c0c-be24-e32cea66a379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:58.407958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:58.412937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-461fb68b-0bb6-4c0c-be24-e32cea66a379 None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:58.414485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-461fb68b-0bb6-4c0c-be24-e32cea66a379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:58.574552 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 701/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Mon Jul 25 22:56:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:01.381999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc8624-13b9-417c-ab97-0d282a3d0edd None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:01.382558 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc8624-13b9-417c-ab97-0d282a3d0edd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:01.382558 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc8624-13b9-417c-ab97-0d282a3d0edd None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:01.384020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:01.391412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e2ab7-cb99-4eb9-9285-a465eb50f9b3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:01.392016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e2ab7-cb99-4eb9-9285-a465eb50f9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:01.392016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e2ab7-cb99-4eb9-9285-a465eb50f9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:01.465368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-566e2ab7-cb99-4eb9-9285-a465eb50f9b3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:01.466620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-566e2ab7-cb99-4eb9-9285-a465eb50f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:01.530126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:01.581408 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:01.628533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc8624-13b9-417c-ab97-0d282a3d0edd None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:01.630309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-55dc8624-13b9-417c-ab97-0d282a3d0edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:01.813789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc8624-13b9-417c-ab97-0d282a3d0edd None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:01.900297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:01.948904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c796c4-638e-4ae4-ab1a-d692e29a62e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:01.949693 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c796c4-638e-4ae4-ab1a-d692e29a62e3 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:01.949969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c796c4-638e-4ae4-ab1a-d692e29a62e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:01.950246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c796c4-638e-4ae4-ab1a-d692e29a62e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:01.951874 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a6c796c4-638e-4ae4-ab1a-d692e29a62e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:02.049209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c796c4-638e-4ae4-ab1a-d692e29a62e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:02.050823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c796c4-638e-4ae4-ab1a-d692e29a62e3 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:02.070173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 714/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:03.027938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32702373-02f5-443b-bb4f-994e936c3727 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:03.028514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32702373-02f5-443b-bb4f-994e936c3727 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:03.028514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32702373-02f5-443b-bb4f-994e936c3727 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:03.030075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:57:03.036058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb06599-424d-4316-b652-0cf1387d8cc3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:03.036613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb06599-424d-4316-b652-0cf1387d8cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:03.037014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb06599-424d-4316-b652-0cf1387d8cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:03.128533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-cdb06599-424d-4316-b652-0cf1387d8cc3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:03.129833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cdb06599-424d-4316-b652-0cf1387d8cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:03.166227 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:03.241346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:03.400721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32702373-02f5-443b-bb4f-994e936c3727 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:03.403379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-32702373-02f5-443b-bb4f-994e936c3727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:03.565747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32702373-02f5-443b-bb4f-994e936c3727 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:03.611291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:03.701456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e3705-baae-4788-894e-4e18bdc85ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:03.701982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e3705-baae-4788-894e-4e18bdc85ec0 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:03.702280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e3705-baae-4788-894e-4e18bdc85ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:03.702548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e3705-baae-4788-894e-4e18bdc85ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:03.704282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b55e3705-baae-4788-894e-4e18bdc85ec0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:03.805556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e3705-baae-4788-894e-4e18bdc85ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:03.807881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e3705-baae-4788-894e-4e18bdc85ec0 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:03.828307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 704/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:04.763724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91787d8-3c80-4984-9978-37a40caebac3 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:04.764282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91787d8-3c80-4984-9978-37a40caebac3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:04.764282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91787d8-3c80-4984-9978-37a40caebac3 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:04.765708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:04.771284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb225e-dbf9-49a9-9f52-55222d1624ad None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:04.771861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb225e-dbf9-49a9-9f52-55222d1624ad None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:04.771861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb225e-dbf9-49a9-9f52-55222d1624ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:04.835192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:04.863331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fafb225e-dbf9-49a9-9f52-55222d1624ad None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:04.864626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fafb225e-dbf9-49a9-9f52-55222d1624ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:04.976514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:05.137971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91787d8-3c80-4984-9978-37a40caebac3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:05.139504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f91787d8-3c80-4984-9978-37a40caebac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:05.302632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91787d8-3c80-4984-9978-37a40caebac3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:05.321883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:05.444956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e54f26-d403-49f8-b2c3-45a0c0515be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:05.445504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e54f26-d403-49f8-b2c3-45a0c0515be6 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:05.445776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e54f26-d403-49f8-b2c3-45a0c0515be6 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:05.446045 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e54f26-d403-49f8-b2c3-45a0c0515be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:05.448358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-42e54f26-d403-49f8-b2c3-45a0c0515be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:05.553136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e54f26-d403-49f8-b2c3-45a0c0515be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:05.554759 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e54f26-d403-49f8-b2c3-45a0c0515be6 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:05.574489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 717/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:06.486875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2abee-d4cd-4504-957d-39db0c43cc19 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:06.487532 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2abee-d4cd-4504-957d-39db0c43cc19 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:06.487532 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2abee-d4cd-4504-957d-39db0c43cc19 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:06.488827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:06.497640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb7e8c-9d87-4c09-a161-07b4a93bf1bd None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:06.498452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb7e8c-9d87-4c09-a161-07b4a93bf1bd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:06.498779 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb7e8c-9d87-4c09-a161-07b4a93bf1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:06.520820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:06.626009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1bcb7e8c-9d87-4c09-a161-07b4a93bf1bd None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:06.628128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1bcb7e8c-9d87-4c09-a161-07b4a93bf1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:06.736930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:06.889872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2abee-d4cd-4504-957d-39db0c43cc19 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:06.891461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f6a2abee-d4cd-4504-957d-39db0c43cc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:07.015937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:07.054545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2abee-d4cd-4504-957d-39db0c43cc19 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:07.189804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760b6d-b24f-42c0-8223-82e5e6864d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:07.190441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760b6d-b24f-42c0-8223-82e5e6864d31 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:07.190722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760b6d-b24f-42c0-8223-82e5e6864d31 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:07.190997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760b6d-b24f-42c0-8223-82e5e6864d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:07.192689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-57760b6d-b24f-42c0-8223-82e5e6864d31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:07.278204 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:07.293168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760b6d-b24f-42c0-8223-82e5e6864d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:07.294831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760b6d-b24f-42c0-8223-82e5e6864d31 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:07.315336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 707/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:08.214983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b144fe-32c8-476b-a4a3-e696c73e3e9b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:08.215557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b144fe-32c8-476b-a4a3-e696c73e3e9b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:08.215557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b144fe-32c8-476b-a4a3-e696c73e3e9b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:08.216824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:57:08.222436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbc37b-5f56-44ef-b808-8095f45f6044 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:08.222965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbc37b-5f56-44ef-b808-8095f45f6044 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:08.222965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbc37b-5f56-44ef-b808-8095f45f6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:08.310937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ccbbc37b-5f56-44ef-b808-8095f45f6044 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:08.312184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ccbbc37b-5f56-44ef-b808-8095f45f6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:08.439892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:08.599075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b144fe-32c8-476b-a4a3-e696c73e3e9b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:08.600740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c2b144fe-32c8-476b-a4a3-e696c73e3e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:08.693490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:08.767909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b144fe-32c8-476b-a4a3-e696c73e3e9b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:08.904761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174114a-8c2b-4cac-b0cc-13f57c09ed4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:08.905423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174114a-8c2b-4cac-b0cc-13f57c09ed4e service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:08.905708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174114a-8c2b-4cac-b0cc-13f57c09ed4e service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:08.905982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174114a-8c2b-4cac-b0cc-13f57c09ed4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:08.907717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1174114a-8c2b-4cac-b0cc-13f57c09ed4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:08.962316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:09.008915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174114a-8c2b-4cac-b0cc-13f57c09ed4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:09.011404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174114a-8c2b-4cac-b0cc-13f57c09ed4e service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:09.031651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 720/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:09.945026 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4664b-64dc-4356-807c-c77639b6a54f None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:09.945620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4664b-64dc-4356-807c-c77639b6a54f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:09.945620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4664b-64dc-4356-807c-c77639b6a54f None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:09.947004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:09.953747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904fadd-7df1-4740-a610-1bf935d55283 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:09.954180 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904fadd-7df1-4740-a610-1bf935d55283 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:09.954284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904fadd-7df1-4740-a610-1bf935d55283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:10.033488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b904fadd-7df1-4740-a610-1bf935d55283 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:10.034723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b904fadd-7df1-4740-a610-1bf935d55283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:10.139296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:10.297607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4664b-64dc-4356-807c-c77639b6a54f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:10.299288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-53a4664b-64dc-4356-807c-c77639b6a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:10.353390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:10.462121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4664b-64dc-4356-807c-c77639b6a54f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:10.584371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205cecf-3b3f-44b9-8569-8960e7861ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:10.584992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205cecf-3b3f-44b9-8569-8960e7861ef5 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:10.585307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205cecf-3b3f-44b9-8569-8960e7861ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:10.585585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205cecf-3b3f-44b9-8569-8960e7861ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:10.587233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b205cecf-3b3f-44b9-8569-8960e7861ef5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:10.594772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:10.683369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205cecf-3b3f-44b9-8569-8960e7861ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:10.684916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205cecf-3b3f-44b9-8569-8960e7861ef5 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:10.703686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 710/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:11.589096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba431c-1e13-4a0c-81e0-81b57041f99b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:11.589705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba431c-1e13-4a0c-81e0-81b57041f99b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:11.589861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba431c-1e13-4a0c-81e0-81b57041f99b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:11.591295 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:11.597304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b78fb-c045-4e24-88e9-6ca6deb9e98d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:11.598020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b78fb-c045-4e24-88e9-6ca6deb9e98d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:11.598020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b78fb-c045-4e24-88e9-6ca6deb9e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:11.682919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0b2b78fb-c045-4e24-88e9-6ca6deb9e98d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:11.684242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0b2b78fb-c045-4e24-88e9-6ca6deb9e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:11.766376 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:11.799425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:11.954378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba431c-1e13-4a0c-81e0-81b57041f99b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:11.956031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-50ba431c-1e13-4a0c-81e0-81b57041f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:11.974271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:12.112968 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba431c-1e13-4a0c-81e0-81b57041f99b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:12.203971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:12.231279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58d4ea-b248-4f71-9592-b7438bc78325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:12.231897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d4ea-b248-4f71-9592-b7438bc78325 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:12.232190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d4ea-b248-4f71-9592-b7438bc78325 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:12.232445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d4ea-b248-4f71-9592-b7438bc78325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:12.234160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0f58d4ea-b248-4f71-9592-b7438bc78325 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:12.333673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58d4ea-b248-4f71-9592-b7438bc78325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:12.335288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58d4ea-b248-4f71-9592-b7438bc78325 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:12.356634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 723/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:13.312199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f6215-3e2f-4998-bb8f-fd69369467df None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:13.313034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f6215-3e2f-4998-bb8f-fd69369467df None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:13.313034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f6215-3e2f-4998-bb8f-fd69369467df None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:13.314817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:13.320367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7c19-1839-4a9b-9cc0-8a77bee866ca None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:13.320901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7c19-1839-4a9b-9cc0-8a77bee866ca None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:13.320901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7c19-1839-4a9b-9cc0-8a77bee866ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:13.407545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c78f7c19-1839-4a9b-9cc0-8a77bee866ca None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:13.408776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c78f7c19-1839-4a9b-9cc0-8a77bee866ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:13.450919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:13.506281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:13.658256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f6215-3e2f-4998-bb8f-fd69369467df None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:13.660178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-858f6215-3e2f-4998-bb8f-fd69369467df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:13.826432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f6215-3e2f-4998-bb8f-fd69369467df None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:13.888196 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:13.950833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59298da8-ffee-4bc9-a40d-149967a52777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:13.951346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59298da8-ffee-4bc9-a40d-149967a52777 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:13.951624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59298da8-ffee-4bc9-a40d-149967a52777 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:13.951904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59298da8-ffee-4bc9-a40d-149967a52777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:13.953584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-59298da8-ffee-4bc9-a40d-149967a52777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:14.051794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59298da8-ffee-4bc9-a40d-149967a52777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:14.053543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59298da8-ffee-4bc9-a40d-149967a52777 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:14.076540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 713/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:14.960728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51f940-c889-449b-b7ba-4882d3425230 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:14.961347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51f940-c889-449b-b7ba-4882d3425230 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:14.961347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51f940-c889-449b-b7ba-4882d3425230 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:14.962748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:14.969163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa34d-63f6-4f7f-ba7e-b8f704be58a2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:14.969692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa34d-63f6-4f7f-ba7e-b8f704be58a2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:14.969692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa34d-63f6-4f7f-ba7e-b8f704be58a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:15.059442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-09bfa34d-63f6-4f7f-ba7e-b8f704be58a2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:15.060693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-09bfa34d-63f6-4f7f-ba7e-b8f704be58a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:15.062955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:15.180528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:15.337210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51f940-c889-449b-b7ba-4882d3425230 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:15.339738 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4b51f940-c889-449b-b7ba-4882d3425230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:15.503304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51f940-c889-449b-b7ba-4882d3425230 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:15.533444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:15.624945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8433f7e-f235-462d-a01d-d642f9362044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:15.625594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8433f7e-f235-462d-a01d-d642f9362044 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:15.625877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8433f7e-f235-462d-a01d-d642f9362044 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:15.626145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8433f7e-f235-462d-a01d-d642f9362044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:15.627776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d8433f7e-f235-462d-a01d-d642f9362044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:15.724256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8433f7e-f235-462d-a01d-d642f9362044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:15.725974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8433f7e-f235-462d-a01d-d642f9362044 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:15.746070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 726/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:57:17.692339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34aa77-a1d1-4c1f-ab46-2a0973e4c48b None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:17.692935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34aa77-a1d1-4c1f-ab46-2a0973e4c48b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:17.692935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34aa77-a1d1-4c1f-ab46-2a0973e4c48b None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:17.694296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:17.701267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2546c-d98f-4017-9a13-01352d087e1c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:17.709325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2546c-d98f-4017-9a13-01352d087e1c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:17.709325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2546c-d98f-4017-9a13-01352d087e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:17.746139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:17.772700 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-54f2546c-d98f-4017-9a13-01352d087e1c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:17.773964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-54f2546c-d98f-4017-9a13-01352d087e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:17.882551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:17.922000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34aa77-a1d1-4c1f-ab46-2a0973e4c48b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:17.928180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ea34aa77-a1d1-4c1f-ab46-2a0973e4c48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:18.038817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34aa77-a1d1-4c1f-ab46-2a0973e4c48b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:18.074295 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:18.118227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282af3f-69ba-4664-b1a7-7096c1b26ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:18.118849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282af3f-69ba-4664-b1a7-7096c1b26ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:18.119175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282af3f-69ba-4664-b1a7-7096c1b26ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:18.120123 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282af3f-69ba-4664-b1a7-7096c1b26ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:18.122113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4282af3f-69ba-4664-b1a7-7096c1b26ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:18.237019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282af3f-69ba-4664-b1a7-7096c1b26ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:18.238505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282af3f-69ba-4664-b1a7-7096c1b26ba8 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:18.256743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 716/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:20.596163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f4f2-f800-4437-a986-bff1fe71b417 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:20.596724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f4f2-f800-4437-a986-bff1fe71b417 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:20.596724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f4f2-f800-4437-a986-bff1fe71b417 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:20.598146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:20.603477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a858d-c777-412a-b2e8-ed47585dc87f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:20.603896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a858d-c777-412a-b2e8-ed47585dc87f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:20.604076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a858d-c777-412a-b2e8-ed47585dc87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:20.672415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2f0a858d-c777-412a-b2e8-ed47585dc87f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:20.673574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2f0a858d-c777-412a-b2e8-ed47585dc87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:20.687061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:20.775847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:20.817405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7f4f2-f800-4437-a986-bff1fe71b417 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:20.818930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9ec7f4f2-f800-4437-a986-bff1fe71b417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:20.944216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7f4f2-f800-4437-a986-bff1fe71b417 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:20.958473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:21.035165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cded3-5a0c-47e1-83b8-633755540dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:21.036823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cded3-5a0c-47e1-83b8-633755540dcb service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:21.037246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cded3-5a0c-47e1-83b8-633755540dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:21.037479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cded3-5a0c-47e1-83b8-633755540dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:21.039233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-889cded3-5a0c-47e1-83b8-633755540dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:21.158668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cded3-5a0c-47e1-83b8-633755540dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:21.160397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cded3-5a0c-47e1-83b8-633755540dcb service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:21.180635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 729/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:23.772608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37818e-0d19-41d3-add4-c7f0e561907e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:23.773193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37818e-0d19-41d3-add4-c7f0e561907e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:23.773193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37818e-0d19-41d3-add4-c7f0e561907e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:23.774539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:23.781086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834965b-e66f-4f7f-b59c-05cd895d84cf None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:23.783519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834965b-e66f-4f7f-b59c-05cd895d84cf None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:23.783519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834965b-e66f-4f7f-b59c-05cd895d84cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:23.837246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:23.859348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9834965b-e66f-4f7f-b59c-05cd895d84cf None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:23.860693 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9834965b-e66f-4f7f-b59c-05cd895d84cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:23.971329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:24.040619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37818e-0d19-41d3-add4-c7f0e561907e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:24.043516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fe37818e-0d19-41d3-add4-c7f0e561907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:24.174423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37818e-0d19-41d3-add4-c7f0e561907e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:24.218209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:24.254257 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a462b32-c14a-4eee-9ed4-a6eb911d805d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:24.254842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a462b32-c14a-4eee-9ed4-a6eb911d805d service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:24.255273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a462b32-c14a-4eee-9ed4-a6eb911d805d service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:24.255402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a462b32-c14a-4eee-9ed4-a6eb911d805d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:24.257063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3a462b32-c14a-4eee-9ed4-a6eb911d805d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:24.378917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a462b32-c14a-4eee-9ed4-a6eb911d805d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:24.380385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a462b32-c14a-4eee-9ed4-a6eb911d805d service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:24.400670 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 719/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:26.627886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81fcaf-4ab2-46a5-bad8-257730b39e3e None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:26.628411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81fcaf-4ab2-46a5-bad8-257730b39e3e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:26.628411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81fcaf-4ab2-46a5-bad8-257730b39e3e None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:26.629780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:26.635687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9add9-ed56-4b1b-8359-0e295a0a9ad0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:26.636153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9add9-ed56-4b1b-8359-0e295a0a9ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:26.636251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9add9-ed56-4b1b-8359-0e295a0a9ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:26.715524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6ce9add9-ed56-4b1b-8359-0e295a0a9ad0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:26.716793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6ce9add9-ed56-4b1b-8359-0e295a0a9ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:26.741945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:26.839681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:26.882167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81fcaf-4ab2-46a5-bad8-257730b39e3e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:26.883644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6a81fcaf-4ab2-46a5-bad8-257730b39e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:27.011380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81fcaf-4ab2-46a5-bad8-257730b39e3e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:27.035986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:27.101514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7689f8-9140-413f-b474-6a8e977694e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:27.102255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7689f8-9140-413f-b474-6a8e977694e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:27.102538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7689f8-9140-413f-b474-6a8e977694e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:27.102819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7689f8-9140-413f-b474-6a8e977694e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:27.105086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-de7689f8-9140-413f-b474-6a8e977694e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:27.242867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7689f8-9140-413f-b474-6a8e977694e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:27.245471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7689f8-9140-413f-b474-6a8e977694e9 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:27.269047 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 732/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:57:29.506470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfdf3b-363c-471c-84f4-0c1b09cba3c4 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:29.507054 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfdf3b-363c-471c-84f4-0c1b09cba3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:29.507054 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfdf3b-363c-471c-84f4-0c1b09cba3c4 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:29.508438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:29.514708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced59a4-220b-48bf-a03a-daf605f01c1c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:29.515274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced59a4-220b-48bf-a03a-daf605f01c1c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:29.515274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced59a4-220b-48bf-a03a-daf605f01c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:29.589369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:29.592414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7ced59a4-220b-48bf-a03a-daf605f01c1c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:29.593688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7ced59a4-220b-48bf-a03a-daf605f01c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:29.698301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:29.738795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfdf3b-363c-471c-84f4-0c1b09cba3c4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:29.740338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-68bfdf3b-363c-471c-84f4-0c1b09cba3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:29.859755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfdf3b-363c-471c-84f4-0c1b09cba3c4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:29.915468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:29.942514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac35d8b-3773-4f24-b22b-a57b0edad958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:29.943143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac35d8b-3773-4f24-b22b-a57b0edad958 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:29.943428 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac35d8b-3773-4f24-b22b-a57b0edad958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:29.943707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac35d8b-3773-4f24-b22b-a57b0edad958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:29.945443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5ac35d8b-3773-4f24-b22b-a57b0edad958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:30.074911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac35d8b-3773-4f24-b22b-a57b0edad958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:30.076387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac35d8b-3773-4f24-b22b-a57b0edad958 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:30.098421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 722/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:32.248858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30c093-937c-4177-bae5-83c4422b4035 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:32.249462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30c093-937c-4177-bae5-83c4422b4035 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:32.249462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30c093-937c-4177-bae5-83c4422b4035 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:32.250782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:32.258020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bf065-c8f3-42a5-a4af-edfb1487691f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:32.258020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bf065-c8f3-42a5-a4af-edfb1487691f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:32.258020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bf065-c8f3-42a5-a4af-edfb1487691f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:32.352350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8e9bf065-c8f3-42a5-a4af-edfb1487691f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:32.354972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8e9bf065-c8f3-42a5-a4af-edfb1487691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:32.404187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:32.510039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:57:32.552478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30c093-937c-4177-bae5-83c4422b4035 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:32.554052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4a30c093-937c-4177-bae5-83c4422b4035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:32.672200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30c093-937c-4177-bae5-83c4422b4035 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:32.704605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:32.765641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99848b-7fb9-4d56-9d85-bcf76e0a25f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:32.766184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99848b-7fb9-4d56-9d85-bcf76e0a25f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:32.766463 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99848b-7fb9-4d56-9d85-bcf76e0a25f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:32.766739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99848b-7fb9-4d56-9d85-bcf76e0a25f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:32.768452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3d99848b-7fb9-4d56-9d85-bcf76e0a25f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:32.968609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99848b-7fb9-4d56-9d85-bcf76e0a25f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:32.970846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99848b-7fb9-4d56-9d85-bcf76e0a25f4 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:32.991904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 735/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:35.207290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f1a0-f4bc-47f9-91fa-44da1a5df98e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:35.207819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f1a0-f4bc-47f9-91fa-44da1a5df98e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:35.207819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f1a0-f4bc-47f9-91fa-44da1a5df98e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:35.209261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:35.216574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39b71-0953-4c96-ae7d-3986c8ab516b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:35.217183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39b71-0953-4c96-ae7d-3986c8ab516b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:35.217183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39b71-0953-4c96-ae7d-3986c8ab516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:35.295156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-97a39b71-0953-4c96-ae7d-3986c8ab516b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:35.296402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-97a39b71-0953-4c96-ae7d-3986c8ab516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:35.306136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:35.403849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:35.443871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5f1a0-f4bc-47f9-91fa-44da1a5df98e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:35.445583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9cd5f1a0-f4bc-47f9-91fa-44da1a5df98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:35.685957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5f1a0-f4bc-47f9-91fa-44da1a5df98e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:35.741605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:35.761737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941014c-7bd7-4144-8479-b56b157359ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:35.762355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941014c-7bd7-4144-8479-b56b157359ca service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:35.762638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941014c-7bd7-4144-8479-b56b157359ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:35.762906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941014c-7bd7-4144-8479-b56b157359ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:35.764581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0941014c-7bd7-4144-8479-b56b157359ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:35.876383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941014c-7bd7-4144-8479-b56b157359ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:35.877861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941014c-7bd7-4144-8479-b56b157359ca service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:35.897034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 725/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:38.013281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2a184-b42d-40ef-afbc-e471f55b3f7c None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:38.013972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2a184-b42d-40ef-afbc-e471f55b3f7c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:38.013972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2a184-b42d-40ef-afbc-e471f55b3f7c None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:38.015220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:38.020921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e55374-b607-48a9-bddd-57470751ea26 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:38.021445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e55374-b607-48a9-bddd-57470751ea26 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:38.021565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e55374-b607-48a9-bddd-57470751ea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:38.094059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-43e55374-b607-48a9-bddd-57470751ea26 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:38.095271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-43e55374-b607-48a9-bddd-57470751ea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:38.135285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:38.195782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:57:38.243435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2a184-b42d-40ef-afbc-e471f55b3f7c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:38.245760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d3a2a184-b42d-40ef-afbc-e471f55b3f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:38.350678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2a184-b42d-40ef-afbc-e471f55b3f7c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:38.393808 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:38.432608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dc9da-91a6-4673-aa85-d3dd9a4bed83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:38.433271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dc9da-91a6-4673-aa85-d3dd9a4bed83 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:38.433557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dc9da-91a6-4673-aa85-d3dd9a4bed83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:38.433832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dc9da-91a6-4673-aa85-d3dd9a4bed83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:38.435493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3f2dc9da-91a6-4673-aa85-d3dd9a4bed83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:38.547193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dc9da-91a6-4673-aa85-d3dd9a4bed83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:38.548709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dc9da-91a6-4673-aa85-d3dd9a4bed83 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:38.566902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 738/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:40.671356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4676287-51fe-44e0-afc0-ebfaab162773 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:40.672220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4676287-51fe-44e0-afc0-ebfaab162773 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:40.672220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4676287-51fe-44e0-afc0-ebfaab162773 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:40.673377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:57:40.679202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9557fe-52f7-4c18-a90e-852e4e7500b7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:40.679962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9557fe-52f7-4c18-a90e-852e4e7500b7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:40.679962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9557fe-52f7-4c18-a90e-852e4e7500b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:40.761033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-fd9557fe-52f7-4c18-a90e-852e4e7500b7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:40.762285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fd9557fe-52f7-4c18-a90e-852e4e7500b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:40.782096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:40.870368 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:40.907694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4676287-51fe-44e0-afc0-ebfaab162773 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:40.909305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c4676287-51fe-44e0-afc0-ebfaab162773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:41.017201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4676287-51fe-44e0-afc0-ebfaab162773 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:41.084779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:41.092853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd3a4d-1bd6-49dc-a439-641407537cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:41.093919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3a4d-1bd6-49dc-a439-641407537cef service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:41.093919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3a4d-1bd6-49dc-a439-641407537cef service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:41.094231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3a4d-1bd6-49dc-a439-641407537cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:41.095707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-94dd3a4d-1bd6-49dc-a439-641407537cef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:41.208258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd3a4d-1bd6-49dc-a439-641407537cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:41.209820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd3a4d-1bd6-49dc-a439-641407537cef service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:41.229440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 728/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:43.319078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d18ede-e545-4235-9526-d44c78e0e402 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:43.319686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d18ede-e545-4235-9526-d44c78e0e402 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:43.319686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d18ede-e545-4235-9526-d44c78e0e402 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:43.321003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:43.326475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f35a0b-059d-4837-bbed-b010c757a5c7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:43.326963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f35a0b-059d-4837-bbed-b010c757a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:43.327069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f35a0b-059d-4837-bbed-b010c757a5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:43.392452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e1f35a0b-059d-4837-bbed-b010c757a5c7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:43.393613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e1f35a0b-059d-4837-bbed-b010c757a5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:43.447744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:43.500235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:43.537411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d18ede-e545-4235-9526-d44c78e0e402 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:43.538939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-42d18ede-e545-4235-9526-d44c78e0e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:43.644075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d18ede-e545-4235-9526-d44c78e0e402 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:43.691727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:43.718360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63084-e476-4c7a-bfdb-35a9d21b49f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:43.718984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63084-e476-4c7a-bfdb-35a9d21b49f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:43.719262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63084-e476-4c7a-bfdb-35a9d21b49f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:43.719543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63084-e476-4c7a-bfdb-35a9d21b49f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:43.721192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fef63084-e476-4c7a-bfdb-35a9d21b49f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:43.834859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63084-e476-4c7a-bfdb-35a9d21b49f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:43.836318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63084-e476-4c7a-bfdb-35a9d21b49f9 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:43.857576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 741/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:53.498346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=22 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:53.854147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=66 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:04.302579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ecaf-b64e-472b-8b6b-bf824e7f1210 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:04.303147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ecaf-b64e-472b-8b6b-bf824e7f1210 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:04.303147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ecaf-b64e-472b-8b6b-bf824e7f1210 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:04.304400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 730/1471] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:58:04.311360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefd6dd-ba27-4c94-b3e5-e0f0bbf34ffb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:04.316175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefd6dd-ba27-4c94-b3e5-e0f0bbf34ffb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:04.316175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefd6dd-ba27-4c94-b3e5-e0f0bbf34ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:04.391676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-dfefd6dd-ba27-4c94-b3e5-e0f0bbf34ffb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:04.393158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-dfefd6dd-ba27-4c94-b3e5-e0f0bbf34ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:04.509135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 742/1472] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:58:04.600765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29eb07-661b-4828-93e0-7b142b2e7fa6 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:04.601060 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29eb07-661b-4828-93e0-7b142b2e7fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:04.601374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29eb07-661b-4828-93e0-7b142b2e7fa6 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:04.603324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 731/1473] 10.222.0.55 () {54 vars in 966 bytes} [Mon Jul 25 22:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:58:04.608955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c35a-eea0-46c9-9d07-5bc38c19aa42 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:04.609262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c35a-eea0-46c9-9d07-5bc38c19aa42 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:04.609676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c35a-eea0-46c9-9d07-5bc38c19aa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:04.698791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3a90c35a-eea0-46c9-9d07-5bc38c19aa42 None None] MFA Rules not processed for user `a911a544e17e4fafb579da66973c431f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:04.700068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3a90c35a-eea0-46c9-9d07-5bc38c19aa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:04.724906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:04.789658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 743/1474] 10.222.0.55 () {58 vars in 1063 bytes} [Mon Jul 25 22:58:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:04.798073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29eb07-661b-4828-93e0-7b142b2e7fa6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:04.799600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8f29eb07-661b-4828-93e0-7b142b2e7fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:04.918000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29eb07-661b-4828-93e0-7b142b2e7fa6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:05.008028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ce7a9-7fe8-47e0-8da8-13505ad4d30a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a911a544e17e4fafb579da66973c431f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:05.009729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce7a9-7fe8-47e0-8da8-13505ad4d30a service glance] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:05.010243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce7a9-7fe8-47e0-8da8-13505ad4d30a service glance] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:05.010738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce7a9-7fe8-47e0-8da8-13505ad4d30a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:05.014050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b54ce7a9-7fe8-47e0-8da8-13505ad4d30a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:05.099381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:05.165190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ce7a9-7fe8-47e0-8da8-13505ad4d30a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:05.166571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ce7a9-7fe8-47e0-8da8-13505ad4d30a service glance] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:05.188123 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 732/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:07.366435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b25a-81d0-41ce-afc9-b8edca10d690 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:07.367025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b25a-81d0-41ce-afc9-b8edca10d690 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:07.367025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b25a-81d0-41ce-afc9-b8edca10d690 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:07.368994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 744/1476] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:58:07.374822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347db6ba-0eb7-4801-8cca-d130d628a323 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:07.375321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347db6ba-0eb7-4801-8cca-d130d628a323 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:07.375419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347db6ba-0eb7-4801-8cca-d130d628a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:07.446869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-347db6ba-0eb7-4801-8cca-d130d628a323 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:07.448111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-347db6ba-0eb7-4801-8cca-d130d628a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:07.550929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 733/1477] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:07.575282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b25a-81d0-41ce-afc9-b8edca10d690 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:07.576870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a2b1b25a-81d0-41ce-afc9-b8edca10d690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:07.718787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b25a-81d0-41ce-afc9-b8edca10d690 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:07.769515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:07.832570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3221cd0-4f8c-4c51-b062-6a071d2b5ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:07.833241 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3221cd0-4f8c-4c51-b062-6a071d2b5ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:07.833561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3221cd0-4f8c-4c51-b062-6a071d2b5ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:07.833840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3221cd0-4f8c-4c51-b062-6a071d2b5ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:07.834566 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3221cd0-4f8c-4c51-b062-6a071d2b5ca8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:07.836966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-b3221cd0-4f8c-4c51-b062-6a071d2b5ca8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:58:07.836966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jul 25 22:58:07.836966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: Jul 25 22:58:07.838177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3221cd0-4f8c-4c51-b062-6a071d2b5ca8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:07.862107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 745/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Mon Jul 25 22:58:07 2022] GET /identity/v3/projects => generated 2553 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:58:10.021827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c9348-fd33-4803-bef9-243cc92f7e50 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:10.022433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c9348-fd33-4803-bef9-243cc92f7e50 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:10.022433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c9348-fd33-4803-bef9-243cc92f7e50 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:10.023766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 734/1479] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:58:10.030075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5087-1701-4889-b4e3-2f6141882112 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:10.030573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5087-1701-4889-b4e3-2f6141882112 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:10.030679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5087-1701-4889-b4e3-2f6141882112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:10.101603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e55f5087-1701-4889-b4e3-2f6141882112 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:10.103555 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e55f5087-1701-4889-b4e3-2f6141882112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:10.219972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 746/1480] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:10.269024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c9348-fd33-4803-bef9-243cc92f7e50 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:10.270593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a13c9348-fd33-4803-bef9-243cc92f7e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:10.282134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:10.431412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c9348-fd33-4803-bef9-243cc92f7e50 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:10.516981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:10.553287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a1ff7-d1d1-4fab-b79a-898f8bce6f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:10.553919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a1ff7-d1d1-4fab-b79a-898f8bce6f63 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:10.554200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a1ff7-d1d1-4fab-b79a-898f8bce6f63 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:10.554477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a1ff7-d1d1-4fab-b79a-898f8bce6f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:10.556420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e50a1ff7-d1d1-4fab-b79a-898f8bce6f63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:10.678027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a1ff7-d1d1-4fab-b79a-898f8bce6f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:10.682107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a1ff7-d1d1-4fab-b79a-898f8bce6f63 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:10.707501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 735/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:12.973108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e878d-4a84-49e0-bf7f-dc7ec5eb33f7 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:12.973714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e878d-4a84-49e0-bf7f-dc7ec5eb33f7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:12.973818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e878d-4a84-49e0-bf7f-dc7ec5eb33f7 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:12.975132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 747/1482] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:58:12.981113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56976614-3b11-4640-b265-689884e931f2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:12.981617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56976614-3b11-4640-b265-689884e931f2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:12.981731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56976614-3b11-4640-b265-689884e931f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:13.061334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-56976614-3b11-4640-b265-689884e931f2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:13.063418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-56976614-3b11-4640-b265-689884e931f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:13.116732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:13.174120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 736/1483] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:58:13.211983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e878d-4a84-49e0-bf7f-dc7ec5eb33f7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:13.214323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1a6e878d-4a84-49e0-bf7f-dc7ec5eb33f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:13.243005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:13.335337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e878d-4a84-49e0-bf7f-dc7ec5eb33f7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:13.420331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc79e4-1e0e-476c-8e71-0ad85c2fc2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:13.420885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc79e4-1e0e-476c-8e71-0ad85c2fc2bc service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:13.421174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc79e4-1e0e-476c-8e71-0ad85c2fc2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:13.421453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc79e4-1e0e-476c-8e71-0ad85c2fc2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:13.423144 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a2fc79e4-1e0e-476c-8e71-0ad85c2fc2bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:13.504767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:13.550049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc79e4-1e0e-476c-8e71-0ad85c2fc2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:13.551490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc79e4-1e0e-476c-8e71-0ad85c2fc2bc service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:13.570360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 748/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:15.693181 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f56356-2820-4259-a0c5-b10b99a559a9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:15.693748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f56356-2820-4259-a0c5-b10b99a559a9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:15.694185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f56356-2820-4259-a0c5-b10b99a559a9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:15.697357 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 737/1485] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:58:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:58:15.703545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1df59-3935-47a0-97d4-78901248f948 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:15.704146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1df59-3935-47a0-97d4-78901248f948 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:15.704146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1df59-3935-47a0-97d4-78901248f948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:15.779700 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-16f1df59-3935-47a0-97d4-78901248f948 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:15.781009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-16f1df59-3935-47a0-97d4-78901248f948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:15.884344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 749/1486] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:15.922570 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f56356-2820-4259-a0c5-b10b99a559a9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:15.924130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-07f56356-2820-4259-a0c5-b10b99a559a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:16.036319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f56356-2820-4259-a0c5-b10b99a559a9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:16.114029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:16.116544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b644238-2bac-4656-a7d4-1a42462bc3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:16.117957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b644238-2bac-4656-a7d4-1a42462bc3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:16.118368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b644238-2bac-4656-a7d4-1a42462bc3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:16.118733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b644238-2bac-4656-a7d4-1a42462bc3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:16.121096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7b644238-2bac-4656-a7d4-1a42462bc3f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:16.241361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b644238-2bac-4656-a7d4-1a42462bc3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:16.242797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b644238-2bac-4656-a7d4-1a42462bc3f2 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:16.262446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 738/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:18.431124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55bff1-c107-44c4-9218-604f7cfa6570 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:18.431742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55bff1-c107-44c4-9218-604f7cfa6570 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:18.431742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55bff1-c107-44c4-9218-604f7cfa6570 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:18.433072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 750/1488] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:58:18.438437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41021240-e94c-4c86-ae1f-da832b5ee577 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:18.438888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41021240-e94c-4c86-ae1f-da832b5ee577 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:18.438986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41021240-e94c-4c86-ae1f-da832b5ee577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:18.505070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-41021240-e94c-4c86-ae1f-da832b5ee577 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:18.506296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-41021240-e94c-4c86-ae1f-da832b5ee577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:18.559925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:18.604099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 739/1489] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:18.645040 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55bff1-c107-44c4-9218-604f7cfa6570 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:18.646661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-eb55bff1-c107-44c4-9218-604f7cfa6570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:18.683289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:18.753660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55bff1-c107-44c4-9218-604f7cfa6570 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:18.829168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea145-177f-436b-b4ca-557153cf1bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:18.829792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea145-177f-436b-b4ca-557153cf1bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:18.830072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea145-177f-436b-b4ca-557153cf1bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:18.830346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea145-177f-436b-b4ca-557153cf1bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:18.831971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4f7ea145-177f-436b-b4ca-557153cf1bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:18.915092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:18.946234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ea145-177f-436b-b4ca-557153cf1bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:18.947062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ea145-177f-436b-b4ca-557153cf1bf6 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:18.965759 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 751/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:21.466510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613109b-1d48-4491-9cf4-e88dc014378a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:21.467096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613109b-1d48-4491-9cf4-e88dc014378a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:21.467096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613109b-1d48-4491-9cf4-e88dc014378a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:21.468471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 740/1491] 10.222.0.55 () {54 vars in 926 bytes} [Mon Jul 25 22:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:58:21.473733 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155db65-882f-486b-897e-63574af0b7d7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:21.474166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155db65-882f-486b-897e-63574af0b7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:21.474273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155db65-882f-486b-897e-63574af0b7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:21.544423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9155db65-882f-486b-897e-63574af0b7d7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:21.545687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9155db65-882f-486b-897e-63574af0b7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:21.662818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 752/1492] 10.222.0.55 () {58 vars in 1023 bytes} [Mon Jul 25 22:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:21.704269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613109b-1d48-4491-9cf4-e88dc014378a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:21.705893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6613109b-1d48-4491-9cf4-e88dc014378a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:21.825421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613109b-1d48-4491-9cf4-e88dc014378a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:21.908105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01d605-5aa4-4dc7-a6bb-8eb474973988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:21.908734 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01d605-5aa4-4dc7-a6bb-8eb474973988 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:21.909335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01d605-5aa4-4dc7-a6bb-8eb474973988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:21.909618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01d605-5aa4-4dc7-a6bb-8eb474973988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:21.911274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3c01d605-5aa4-4dc7-a6bb-8eb474973988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:21.922085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:22.032049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01d605-5aa4-4dc7-a6bb-8eb474973988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:22.033555 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01d605-5aa4-4dc7-a6bb-8eb474973988 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:22.056800 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 741/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:31.658252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=82 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:32.059536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=50 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:03.616305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6860-f915-43bf-9c4f-b21f71b92354 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:03.617152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6860-f915-43bf-9c4f-b21f71b92354 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:03.617847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6860-f915-43bf-9c4f-b21f71b92354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:03.725361 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4e4a6860-f915-43bf-9c4f-b21f71b92354 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:03.726832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4e4a6860-f915-43bf-9c4f-b21f71b92354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:03.872479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 753/1494] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:03.882590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0efaf3-6612-4c7e-9be2-01dd9324bbdf None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:03.884424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0efaf3-6612-4c7e-9be2-01dd9324bbdf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:03.884424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0efaf3-6612-4c7e-9be2-01dd9324bbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:03.906173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ae0efaf3-6612-4c7e-9be2-01dd9324bbdf None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:03.907553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ae0efaf3-6612-4c7e-9be2-01dd9324bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:03.922896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 742/1495] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:03.928600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a6860-f915-43bf-9c4f-b21f71b92354 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:03.938826 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a6860-f915-43bf-9c4f-b21f71b92354 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:03.944408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f405fb-4c60-4ce9-af85-ec086848d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:03.945752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f405fb-4c60-4ce9-af85-ec086848d3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:03.945752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f405fb-4c60-4ce9-af85-ec086848d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:03.945752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f405fb-4c60-4ce9-af85-ec086848d3b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:03.946288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f405fb-4c60-4ce9-af85-ec086848d3b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:00:03.946651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f405fb-4c60-4ce9-af85-ec086848d3b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:03.947659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-a6f405fb-4c60-4ce9-af85-ec086848d3b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:00:03.947659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jul 25 23:00:03.947659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: Jul 25 23:00:03.948819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f405fb-4c60-4ce9-af85-ec086848d3b0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:03.961874 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 754/1496] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:00:03.971432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0efaf3-6612-4c7e-9be2-01dd9324bbdf None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:03.981747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0efaf3-6612-4c7e-9be2-01dd9324bbdf None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:03.986397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21783183-7af7-4470-b48b-97f72d5893c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:03.987028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21783183-7af7-4470-b48b-97f72d5893c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:03.987315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21783183-7af7-4470-b48b-97f72d5893c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:03.987590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21783183-7af7-4470-b48b-97f72d5893c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:03.988278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21783183-7af7-4470-b48b-97f72d5893c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:03.990603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-21783183-7af7-4470-b48b-97f72d5893c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:00:03.990603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jul 25 23:00:03.990603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: Jul 25 23:00:03.991842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21783183-7af7-4470-b48b-97f72d5893c2 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:04.140053 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 743/1497] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:03 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:04.144705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f405fb-4c60-4ce9-af85-ec086848d3b0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:04.163297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f405fb-4c60-4ce9-af85-ec086848d3b0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:04.227111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:04.235333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e29953-a913-45aa-b3aa-f756f3eb1a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:04.235974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29953-a913-45aa-b3aa-f756f3eb1a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:04.236252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29953-a913-45aa-b3aa-f756f3eb1a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:04.238341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29953-a913-45aa-b3aa-f756f3eb1a84 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:04.238341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e29953-a913-45aa-b3aa-f756f3eb1a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:04.238341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-f6e29953-a913-45aa-b3aa-f756f3eb1a84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:00:04.238341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jul 25 23:00:04.238341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: Jul 25 23:00:04.239466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e29953-a913-45aa-b3aa-f756f3eb1a84 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:04.404383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 755/1498] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:04 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:04.409044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21783183-7af7-4470-b48b-97f72d5893c2 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:04.420853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21783183-7af7-4470-b48b-97f72d5893c2 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:04.425628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b80d0-137f-480a-963a-65650f1530c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:04.426299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b80d0-137f-480a-963a-65650f1530c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:04.426579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b80d0-137f-480a-963a-65650f1530c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:04.426852 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b80d0-137f-480a-963a-65650f1530c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:04.427582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b80d0-137f-480a-963a-65650f1530c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:04.429276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-c77b80d0-137f-480a-963a-65650f1530c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:00:04.429276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jul 25 23:00:04.429276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: Jul 25 23:00:04.430190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b80d0-137f-480a-963a-65650f1530c3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:04.444040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 744/1499] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:04.448484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e29953-a913-45aa-b3aa-f756f3eb1a84 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:04.460451 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e29953-a913-45aa-b3aa-f756f3eb1a84 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:04.467362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464a8a3-276b-4e8f-8a2a-6680a4b3b775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:04.468541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464a8a3-276b-4e8f-8a2a-6680a4b3b775 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:04.469153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464a8a3-276b-4e8f-8a2a-6680a4b3b775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:04.469686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464a8a3-276b-4e8f-8a2a-6680a4b3b775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:04.471047 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464a8a3-276b-4e8f-8a2a-6680a4b3b775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:04.472466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-c464a8a3-276b-4e8f-8a2a-6680a4b3b775 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:00:04.472466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jul 25 23:00:04.472466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: Jul 25 23:00:04.473457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464a8a3-276b-4e8f-8a2a-6680a4b3b775 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:04.489506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 756/1500] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:04.494832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b80d0-137f-480a-963a-65650f1530c3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:04.506319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b80d0-137f-480a-963a-65650f1530c3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:04.511507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81817b34-95b9-479a-995f-03ec42c6892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:04.512185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81817b34-95b9-479a-995f-03ec42c6892f admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:04.512466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81817b34-95b9-479a-995f-03ec42c6892f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:04.512753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81817b34-95b9-479a-995f-03ec42c6892f admin admin] PATH_INFO: `/v3/projects/e33058f334e24235bc7f1744bf9c055e/users/bc4cee4cc4924f51b55aa57d8fe624af/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:04.528717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81817b34-95b9-479a-995f-03ec42c6892f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33058f334e24235bc7f1744bf9c055e, user_id=bc4cee4cc4924f51b55aa57d8fe624af, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:04.529822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-81817b34-95b9-479a-995f-03ec42c6892f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:00:04.529822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jul 25 23:00:04.529822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: Jul 25 23:00:04.531796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81817b34-95b9-479a-995f-03ec42c6892f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:04.671136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 745/1501] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:04 2022] PUT /identity/v3/projects/e33058f334e24235bc7f1744bf9c055e/users/bc4cee4cc4924f51b55aa57d8fe624af/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:04.684133 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6f504-680a-444f-84f0-dc22c36c87a0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:04.685304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6f504-680a-444f-84f0-dc22c36c87a0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:04.685304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6f504-680a-444f-84f0-dc22c36c87a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:04.714395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e9d6f504-680a-444f-84f0-dc22c36c87a0 None None] MFA Rules not processed for user `bc4cee4cc4924f51b55aa57d8fe624af`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:04.715999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e9d6f504-680a-444f-84f0-dc22c36c87a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:04.785446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 757/1502] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:00:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:04.799753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14a0f-6ade-4a08-8aa9-0fb5b5638bfc None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:04.800037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14a0f-6ade-4a08-8aa9-0fb5b5638bfc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:04.800306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14a0f-6ade-4a08-8aa9-0fb5b5638bfc None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:04.801684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 746/1503] 10.222.0.55 () {54 vars in 964 bytes} [Mon Jul 25 23:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:00:04.808449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a35ab-bf27-4b42-bbba-495d27c06cd2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:04.808741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a35ab-bf27-4b42-bbba-495d27c06cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:04.809015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a35ab-bf27-4b42-bbba-495d27c06cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:04.878829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-844a35ab-bf27-4b42-bbba-495d27c06cd2 None None] MFA Rules not processed for user `3ccf6c1a5c044294a8eb83c877a6316e`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:04.880065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-844a35ab-bf27-4b42-bbba-495d27c06cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:04.962018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 758/1504] 10.222.0.55 () {58 vars in 1061 bytes} [Mon Jul 25 23:00:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:04.969718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14a0f-6ade-4a08-8aa9-0fb5b5638bfc None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:04.982571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14a0f-6ade-4a08-8aa9-0fb5b5638bfc None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:04.986135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cdd14-9add-4010-823e-b23bd2c45abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:04.986736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cdd14-9add-4010-823e-b23bd2c45abb service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:04.987016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cdd14-9add-4010-823e-b23bd2c45abb service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:04.987291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cdd14-9add-4010-823e-b23bd2c45abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:04.995955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cdd14-9add-4010-823e-b23bd2c45abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:04.997426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cdd14-9add-4010-823e-b23bd2c45abb service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:05.007040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 747/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:05.057534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8292ba-863d-4baa-864c-aecbd688c298 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:05.057830 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8292ba-863d-4baa-864c-aecbd688c298 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:05.058109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8292ba-863d-4baa-864c-aecbd688c298 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:05.059465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 759/1506] 10.222.0.55 () {52 vars in 830 bytes} [Mon Jul 25 23:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:00:05.063253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cdd14-9add-4010-823e-b23bd2c45abb service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:05.128597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cdd14-9add-4010-823e-b23bd2c45abb service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:05.134604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:05.135252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:05.135534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:05.135808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] PATH_INFO: `/v3/users/bc4cee4cc4924f51b55aa57d8fe624af` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:05.137004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4cee4cc4924f51b55aa57d8fe624af)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:05.138085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:00:05.138085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jul 25 23:00:05.138085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: Jul 25 23:00:05.139314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:05.387833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4cee4cc4924f51b55aa57d8fe624af'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:05.388595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4cee4cc4924f51b55aa57d8fe624af'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:05.483458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4cee4cc4924f51b55aa57d8fe624af'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:05.506253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4cee4cc4924f51b55aa57d8fe624af'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:05.515126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:05.520047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4cee4cc4924f51b55aa57d8fe624af'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:05.527367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 748/1507] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:05 2022] DELETE /identity/v3/users/bc4cee4cc4924f51b55aa57d8fe624af => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:05.533364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a7063-9561-4e72-a0be-e62ca356c3ef None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:05.533364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a7063-9561-4e72-a0be-e62ca356c3ef None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:05.533364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a7063-9561-4e72-a0be-e62ca356c3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:05.555090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-490a7063-9561-4e72-a0be-e62ca356c3ef None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:05.556374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-490a7063-9561-4e72-a0be-e62ca356c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:05.566064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:05.620153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 760/1508] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:05.630681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:05.632281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:05.713479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266d13e-648f-44e4-a498-d4128b6b0b2a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:05.717481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9445815-c2de-46de-84d6-da1127904420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:05.718115 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445815-c2de-46de-84d6-da1127904420 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:05.718395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445815-c2de-46de-84d6-da1127904420 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:05.718668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445815-c2de-46de-84d6-da1127904420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:05.729681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9445815-c2de-46de-84d6-da1127904420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:05.731156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9445815-c2de-46de-84d6-da1127904420 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:05.742855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 749/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:06.251357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a7063-9561-4e72-a0be-e62ca356c3ef None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:06.253589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-490a7063-9561-4e72-a0be-e62ca356c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:06.267543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a7063-9561-4e72-a0be-e62ca356c3ef None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:06.272870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:06.274253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.274545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.274820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] PATH_INFO: `/v3/projects/e33058f334e24235bc7f1744bf9c055e` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.276125 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33058f334e24235bc7f1744bf9c055e)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:06.277193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:00:06.277193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jul 25 23:00:06.277193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: Jul 25 23:00:06.278493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:06.414102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33058f334e24235bc7f1744bf9c055e', 'request_id': 'req-a7c69312-4b85-4df3-a594-bc85a01dce0c'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.427469 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33058f334e24235bc7f1744bf9c055e', 'request_id': 'req-a7c69312-4b85-4df3-a594-bc85a01dce0c'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.434274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33058f334e24235bc7f1744bf9c055e', 'request_id': 'req-a7c69312-4b85-4df3-a594-bc85a01dce0c'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.546559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] The token cache is being invalidate because project e33058f334e24235bc7f1744bf9c055e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:06.546837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.547527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7c69312-4b85-4df3-a594-bc85a01dce0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.549227 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 761/1510] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:06 2022] DELETE /identity/v3/projects/e33058f334e24235bc7f1744bf9c055e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:15.737306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=38 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:16.543252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:49.992675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca0f8-4ce4-4c19-a9da-bf7289bf034d None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.993324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca0f8-4ce4-4c19-a9da-bf7289bf034d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.993324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca0f8-4ce4-4c19-a9da-bf7289bf034d None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.994652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:49.999925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e916d0b-c880-433f-8698-590e4481f864 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.000500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e916d0b-c880-433f-8698-590e4481f864 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.000500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e916d0b-c880-433f-8698-590e4481f864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.021614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1e916d0b-c880-433f-8698-590e4481f864 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:50.023597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1e916d0b-c880-433f-8698-590e4481f864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:50.091254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:50.254602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ca0f8-4ce4-4c19-a9da-bf7289bf034d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.256947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-929ca0f8-4ce4-4c19-a9da-bf7289bf034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:50.369284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ca0f8-4ce4-4c19-a9da-bf7289bf034d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.375192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96465624-1f7f-4a36-9f0a-dfebda7e3810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.375911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465624-1f7f-4a36-9f0a-dfebda7e3810 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.376198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465624-1f7f-4a36-9f0a-dfebda7e3810 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.376472 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465624-1f7f-4a36-9f0a-dfebda7e3810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.386330 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96465624-1f7f-4a36-9f0a-dfebda7e3810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.387970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96465624-1f7f-4a36-9f0a-dfebda7e3810 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.398648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 751/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:51.251440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d37fc3-226c-4e33-b897-b962c19c2dbe None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.251977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d37fc3-226c-4e33-b897-b962c19c2dbe None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.251977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d37fc3-226c-4e33-b897-b962c19c2dbe None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.253366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:51.259252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dca41-69e5-4ff7-b546-ad70fe84e331 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.259740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dca41-69e5-4ff7-b546-ad70fe84e331 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.259858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dca41-69e5-4ff7-b546-ad70fe84e331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.283341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-760dca41-69e5-4ff7-b546-ad70fe84e331 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:51.284556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-760dca41-69e5-4ff7-b546-ad70fe84e331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:51.293110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:51.453758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d37fc3-226c-4e33-b897-b962c19c2dbe None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:51.473627 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d37fc3-226c-4e33-b897-b962c19c2dbe None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:51.482812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f5910-a811-45f5-90fc-ebe15e84744c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:51.483717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f5910-a811-45f5-90fc-ebe15e84744c service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.484266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f5910-a811-45f5-90fc-ebe15e84744c service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.484555 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f5910-a811-45f5-90fc-ebe15e84744c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.494625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f5910-a811-45f5-90fc-ebe15e84744c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:51.496268 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f5910-a811-45f5-90fc-ebe15e84744c service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:51.507748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 764/1516] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:51.695954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6ec64-b012-45eb-9d90-e1d2c8e31bb6 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.696232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6ec64-b012-45eb-9d90-e1d2c8e31bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.696506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6ec64-b012-45eb-9d90-e1d2c8e31bb6 None None] PATH_INFO: `/v3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.697858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 753/1517] 10.222.0.39 () {54 vars in 925 bytes} [Mon Jul 25 23:01:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:51.705592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92b320-7510-40bd-88d2-a4e2e3f26f43 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.705894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92b320-7510-40bd-88d2-a4e2e3f26f43 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.706160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92b320-7510-40bd-88d2-a4e2e3f26f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.761773 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5f92b320-7510-40bd-88d2-a4e2e3f26f43 None None] MFA Rules not processed for user `0aa69689b82d4994beac3b698d40c37f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:51.762916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5f92b320-7510-40bd-88d2-a4e2e3f26f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:51.846663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 765/1518] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Jul 25 23:01:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:00.954195 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e234b-4801-4fe6-8f28-df489072d4c3 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.954776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e234b-4801-4fe6-8f28-df489072d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.954776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e234b-4801-4fe6-8f28-df489072d4c3 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.956099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 754/1519] 10.222.0.55 () {54 vars in 961 bytes} [Mon Jul 25 23:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:00.962154 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b2cb-8450-413a-8e1d-19caf88c99fe None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.962712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b2cb-8450-413a-8e1d-19caf88c99fe None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.962712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b2cb-8450-413a-8e1d-19caf88c99fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.983566 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2ae7b2cb-8450-413a-8e1d-19caf88c99fe None None] MFA Rules not processed for user `0aa69689b82d4994beac3b698d40c37f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:00.984788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2ae7b2cb-8450-413a-8e1d-19caf88c99fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:00.994053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 766/1520] 10.222.0.55 () {58 vars in 1058 bytes} [Mon Jul 25 23:02:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:01.002066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e234b-4801-4fe6-8f28-df489072d4c3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:01.016049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e234b-4801-4fe6-8f28-df489072d4c3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:01.021052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec62fd-b2df-49f3-a51a-ed9526a57b36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:01.021705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec62fd-b2df-49f3-a51a-ed9526a57b36 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:01.021987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec62fd-b2df-49f3-a51a-ed9526a57b36 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:01.022265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec62fd-b2df-49f3-a51a-ed9526a57b36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:01.032809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec62fd-b2df-49f3-a51a-ed9526a57b36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:01.034517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec62fd-b2df-49f3-a51a-ed9526a57b36 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:01.045699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 755/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:02.807286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5ec5d-f229-492d-9e8c-c83072335a81 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.807867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5ec5d-f229-492d-9e8c-c83072335a81 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.807867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5ec5d-f229-492d-9e8c-c83072335a81 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.809289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:02.814675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e8c5-60db-407d-a8cb-16fa173e9007 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.815169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e8c5-60db-407d-a8cb-16fa173e9007 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.815169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e8c5-60db-407d-a8cb-16fa173e9007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.837247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fe93e8c5-60db-407d-a8cb-16fa173e9007 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:02.838567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fe93e8c5-60db-407d-a8cb-16fa173e9007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:02.851350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:03.009519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5ec5d-f229-492d-9e8c-c83072335a81 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:03.024384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5ec5d-f229-492d-9e8c-c83072335a81 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:03.030160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efd9fa-6739-4a6e-b3a1-0094e3b0ec83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:03.030802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd9fa-6739-4a6e-b3a1-0094e3b0ec83 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.031087 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd9fa-6739-4a6e-b3a1-0094e3b0ec83 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.031614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd9fa-6739-4a6e-b3a1-0094e3b0ec83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.040686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efd9fa-6739-4a6e-b3a1-0094e3b0ec83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:03.042347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efd9fa-6739-4a6e-b3a1-0094e3b0ec83 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.052167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 768/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:03.912909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6e652-081e-4b26-977b-cfbe1c2aebdb None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.913553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6e652-081e-4b26-977b-cfbe1c2aebdb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.913553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6e652-081e-4b26-977b-cfbe1c2aebdb None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.915188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:03.920793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6f1aa-a228-4730-bbd3-e907d9533df0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.921430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6f1aa-a228-4730-bbd3-e907d9533df0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.921430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6f1aa-a228-4730-bbd3-e907d9533df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.945819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4aa6f1aa-a228-4730-bbd3-e907d9533df0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:03.947177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4aa6f1aa-a228-4730-bbd3-e907d9533df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:03.955401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:04.109838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6e652-081e-4b26-977b-cfbe1c2aebdb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.124578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6e652-081e-4b26-977b-cfbe1c2aebdb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.130214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41536-6f4a-452d-8900-0ffac9c7af16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.130900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41536-6f4a-452d-8900-0ffac9c7af16 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.131216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41536-6f4a-452d-8900-0ffac9c7af16 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.131500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41536-6f4a-452d-8900-0ffac9c7af16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.143094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd41536-6f4a-452d-8900-0ffac9c7af16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:04.143094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd41536-6f4a-452d-8900-0ffac9c7af16 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:04.154318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 758/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:08.475146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082761c4-5287-4baa-a687-ccd910cda8d9 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.475788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082761c4-5287-4baa-a687-ccd910cda8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.475788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082761c4-5287-4baa-a687-ccd910cda8d9 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.477695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:08.483173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101a3a8-0a92-435a-a8bc-8e70d7bdc4f7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.483574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101a3a8-0a92-435a-a8bc-8e70d7bdc4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.483782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101a3a8-0a92-435a-a8bc-8e70d7bdc4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.502921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b101a3a8-0a92-435a-a8bc-8e70d7bdc4f7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:08.504160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b101a3a8-0a92-435a-a8bc-8e70d7bdc4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:08.512088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:08.587363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082761c4-5287-4baa-a687-ccd910cda8d9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:08.589068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-082761c4-5287-4baa-a687-ccd910cda8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:08.618006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:08.646602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082761c4-5287-4baa-a687-ccd910cda8d9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:08.650869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4854e70-2809-4b87-b4ce-c500cc9a393b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:08.651487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4854e70-2809-4b87-b4ce-c500cc9a393b service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.651765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4854e70-2809-4b87-b4ce-c500cc9a393b service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.652038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4854e70-2809-4b87-b4ce-c500cc9a393b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.661463 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4854e70-2809-4b87-b4ce-c500cc9a393b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:08.662889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4854e70-2809-4b87-b4ce-c500cc9a393b service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:08.672713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 771/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:10.699579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8caec-3d54-402a-9404-fa0cfa280385 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:10.700163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8caec-3d54-402a-9404-fa0cfa280385 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:10.700163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8caec-3d54-402a-9404-fa0cfa280385 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:10.701517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:10.707133 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530ec93-0d7f-4b9f-9629-d76ee9e0a4ae None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:10.707634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530ec93-0d7f-4b9f-9629-d76ee9e0a4ae None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:10.707753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530ec93-0d7f-4b9f-9629-d76ee9e0a4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:10.728528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7530ec93-0d7f-4b9f-9629-d76ee9e0a4ae None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:10.729760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7530ec93-0d7f-4b9f-9629-d76ee9e0a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:10.737466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:10.773876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8caec-3d54-402a-9404-fa0cfa280385 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:10.784886 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8caec-3d54-402a-9404-fa0cfa280385 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:10.788380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d903f7-b446-4219-a1a1-9388c714b586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:10.789653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d903f7-b446-4219-a1a1-9388c714b586 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:10.789934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d903f7-b446-4219-a1a1-9388c714b586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:10.790209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d903f7-b446-4219-a1a1-9388c714b586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:10.799146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d903f7-b446-4219-a1a1-9388c714b586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:10.800574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d903f7-b446-4219-a1a1-9388c714b586 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:10.810042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 761/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:14.312632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49205530-cb14-40d5-8439-df4c41f96051 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:14.313290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49205530-cb14-40d5-8439-df4c41f96051 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:14.313290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49205530-cb14-40d5-8439-df4c41f96051 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:14.314569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:14.320761 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0542-8a2d-4e82-9936-bbd0b0b1c2e2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:14.321310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0542-8a2d-4e82-9936-bbd0b0b1c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:14.321310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0542-8a2d-4e82-9936-bbd0b0b1c2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:14.342191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-179a0542-8a2d-4e82-9936-bbd0b0b1c2e2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:14.343434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-179a0542-8a2d-4e82-9936-bbd0b0b1c2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:14.351990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:14.660328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49205530-cb14-40d5-8439-df4c41f96051 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:14.662051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-49205530-cb14-40d5-8439-df4c41f96051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:14.719038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49205530-cb14-40d5-8439-df4c41f96051 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:14.722587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc5793-44a3-48da-b568-f6b1a411779b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:14.723213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc5793-44a3-48da-b568-f6b1a411779b service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:14.723494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc5793-44a3-48da-b568-f6b1a411779b service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:14.723770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc5793-44a3-48da-b568-f6b1a411779b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:14.734096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc5793-44a3-48da-b568-f6b1a411779b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:14.735533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc5793-44a3-48da-b568-f6b1a411779b service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:14.745728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 774/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:16.808245 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfd501-6e1a-4b6e-bdfe-49690fb82e4f None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.808853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfd501-6e1a-4b6e-bdfe-49690fb82e4f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.808853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfd501-6e1a-4b6e-bdfe-49690fb82e4f None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.810171 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:16.816135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1ca7-cb9d-4876-a547-76d3a460e824 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.816758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1ca7-cb9d-4876-a547-76d3a460e824 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.817052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1ca7-cb9d-4876-a547-76d3a460e824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.837927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8e4f1ca7-cb9d-4876-a547-76d3a460e824 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:16.839070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8e4f1ca7-cb9d-4876-a547-76d3a460e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:16.847419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:17.160977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfd501-6e1a-4b6e-bdfe-49690fb82e4f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.162690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-61cfd501-6e1a-4b6e-bdfe-49690fb82e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:17.171103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=77 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:17.177205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfd501-6e1a-4b6e-bdfe-49690fb82e4f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.180950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a58c5-4fe4-4404-8c38-1b2fa27be9c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.181597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a58c5-4fe4-4404-8c38-1b2fa27be9c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.181881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a58c5-4fe4-4404-8c38-1b2fa27be9c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.182157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a58c5-4fe4-4404-8c38-1b2fa27be9c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.191460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a58c5-4fe4-4404-8c38-1b2fa27be9c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:17.192892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a58c5-4fe4-4404-8c38-1b2fa27be9c5 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:17.203197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 764/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:26.832006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=47 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:27.236584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:46.202055 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689653-68c2-401a-9467-5b63a96e133d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.202718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689653-68c2-401a-9467-5b63a96e133d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.202718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689653-68c2-401a-9467-5b63a96e133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.236048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-50689653-68c2-401a-9467-5b63a96e133d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:46.237300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-50689653-68c2-401a-9467-5b63a96e133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:46.248916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 776/1540] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:03:46.258650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad991c-7b42-4899-9262-4cc55809b4ef None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.259220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad991c-7b42-4899-9262-4cc55809b4ef None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.259220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad991c-7b42-4899-9262-4cc55809b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.287782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-99ad991c-7b42-4899-9262-4cc55809b4ef None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:46.289384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-99ad991c-7b42-4899-9262-4cc55809b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:46.299794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 765/1541] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:46.305036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50689653-68c2-401a-9467-5b63a96e133d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:46.319094 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50689653-68c2-401a-9467-5b63a96e133d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:46.329271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f6a92-acfa-4c4b-bde3-4adcf4a8bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:46.330426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f6a92-acfa-4c4b-bde3-4adcf4a8bc63 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.330712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f6a92-acfa-4c4b-bde3-4adcf4a8bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.330985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f6a92-acfa-4c4b-bde3-4adcf4a8bc63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.331705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f6a92-acfa-4c4b-bde3-4adcf4a8bc63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:46.332015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f6a92-acfa-4c4b-bde3-4adcf4a8bc63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:46.335044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f6a92-acfa-4c4b-bde3-4adcf4a8bc63 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:46.354427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 777/1542] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:46.363416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad991c-7b42-4899-9262-4cc55809b4ef None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:46.378921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad991c-7b42-4899-9262-4cc55809b4ef None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:46.393993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ba02-d344-4eb9-8a6f-ab0f17e77147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:46.394651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ba02-d344-4eb9-8a6f-ab0f17e77147 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.394936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ba02-d344-4eb9-8a6f-ab0f17e77147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.395208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ba02-d344-4eb9-8a6f-ab0f17e77147 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.395900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ba02-d344-4eb9-8a6f-ab0f17e77147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:46.397875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ba02-d344-4eb9-8a6f-ab0f17e77147 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:46.475606 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00130c-a7a0-44e8-88cb-7c71013176b8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.475809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00130c-a7a0-44e8-88cb-7c71013176b8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.476152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00130c-a7a0-44e8-88cb-7c71013176b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.518403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-da00130c-a7a0-44e8-88cb-7c71013176b8 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:46.520775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-da00130c-a7a0-44e8-88cb-7c71013176b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:46.534424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 778/1543] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:46.536158 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 766/1544] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:46 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:46.540853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00130c-a7a0-44e8-88cb-7c71013176b8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:46.553602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8991-1f1e-4d85-937c-15154bee09e4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.554244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8991-1f1e-4d85-937c-15154bee09e4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.554783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8991-1f1e-4d85-937c-15154bee09e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.555089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00130c-a7a0-44e8-88cb-7c71013176b8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:46.584579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-eeac8991-1f1e-4d85-937c-15154bee09e4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:46.586269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-eeac8991-1f1e-4d85-937c-15154bee09e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:46.692889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5c2ff-6197-406f-88e8-60ae985b7bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:46.694239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5c2ff-6197-406f-88e8-60ae985b7bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.694705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5c2ff-6197-406f-88e8-60ae985b7bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.695160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5c2ff-6197-406f-88e8-60ae985b7bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.696037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5c2ff-6197-406f-88e8-60ae985b7bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:46.698504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5c2ff-6197-406f-88e8-60ae985b7bf8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:46.740719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 767/1545] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:03:46.745992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac8991-1f1e-4d85-937c-15154bee09e4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:46.759068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac8991-1f1e-4d85-937c-15154bee09e4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:46.774000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575a6e3-7d39-4420-9b9d-010576ebb6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:46.774659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575a6e3-7d39-4420-9b9d-010576ebb6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.774946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575a6e3-7d39-4420-9b9d-010576ebb6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.775225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575a6e3-7d39-4420-9b9d-010576ebb6c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.775989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575a6e3-7d39-4420-9b9d-010576ebb6c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:46.776307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575a6e3-7d39-4420-9b9d-010576ebb6c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:46.778055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-9575a6e3-7d39-4420-9b9d-010576ebb6c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:03:46.778055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jul 25 23:03:46.778055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: Jul 25 23:03:46.779130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575a6e3-7d39-4420-9b9d-010576ebb6c7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:46.797023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 768/1546] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:46.813355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575a6e3-7d39-4420-9b9d-010576ebb6c7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:46.815501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 779/1547] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:46 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:46.820476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5c2ff-6197-406f-88e8-60ae985b7bf8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:46.827589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575a6e3-7d39-4420-9b9d-010576ebb6c7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:46.838500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5c2ff-6197-406f-88e8-60ae985b7bf8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:46.844972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a6de3-edd9-49fd-b386-c0dee4a44245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:46.845648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a6de3-edd9-49fd-b386-c0dee4a44245 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.845932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a6de3-edd9-49fd-b386-c0dee4a44245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.846211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a6de3-edd9-49fd-b386-c0dee4a44245 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.846895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a6de3-edd9-49fd-b386-c0dee4a44245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:46.851538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a6de3-edd9-49fd-b386-c0dee4a44245 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:46.868718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3001a7-e0d8-47fe-a3ef-17dc4a401b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:46.869729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3001a7-e0d8-47fe-a3ef-17dc4a401b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.870196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3001a7-e0d8-47fe-a3ef-17dc4a401b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.870647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3001a7-e0d8-47fe-a3ef-17dc4a401b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.872119 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3001a7-e0d8-47fe-a3ef-17dc4a401b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:46.874118 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3001a7-e0d8-47fe-a3ef-17dc4a401b25 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:46.894373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 780/1548] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:46.899211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3001a7-e0d8-47fe-a3ef-17dc4a401b25 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:46.914541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3001a7-e0d8-47fe-a3ef-17dc4a401b25 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:46.922907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a129d-868e-4c85-afde-6423d293f996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:46.923826 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a129d-868e-4c85-afde-6423d293f996 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.924289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a129d-868e-4c85-afde-6423d293f996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.924728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a129d-868e-4c85-afde-6423d293f996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.925704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a129d-868e-4c85-afde-6423d293f996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:46.927655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a129d-868e-4c85-afde-6423d293f996 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:46.945654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 781/1549] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:46.947280 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124793a-b134-42cf-8f86-0961db05e2db None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:46.947734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124793a-b134-42cf-8f86-0961db05e2db None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:46.948191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124793a-b134-42cf-8f86-0961db05e2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:46.990534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6124793a-b134-42cf-8f86-0961db05e2db None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:46.992276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6124793a-b134-42cf-8f86-0961db05e2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.004677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 782/1550] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.005870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124793a-b134-42cf-8f86-0961db05e2db None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.023607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124793a-b134-42cf-8f86-0961db05e2db None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.033912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f7d6-6c51-4e6f-aa66-147b3913661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.034845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f7d6-6c51-4e6f-aa66-147b3913661b admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.035304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f7d6-6c51-4e6f-aa66-147b3913661b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.035469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 769/1551] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:46 2022] POST /identity/v3/projects => generated 393 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:03:47.035910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f7d6-6c51-4e6f-aa66-147b3913661b admin admin] PATH_INFO: `/v3/projects/b5758d6346314cb3bac448b4b052e32c/users/a491d60bff954b48ac0d3333ea77643b/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.040076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21537a4a-836a-4eac-90b1-6638a1f1b936 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.040076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21537a4a-836a-4eac-90b1-6638a1f1b936 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.040076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21537a4a-836a-4eac-90b1-6638a1f1b936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.060307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f7d6-6c51-4e6f-aa66-147b3913661b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5758d6346314cb3bac448b4b052e32c, user_id=a491d60bff954b48ac0d3333ea77643b, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.061681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-9e04f7d6-6c51-4e6f-aa66-147b3913661b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:03:47.061681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jul 25 23:03:47.061681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: Jul 25 23:03:47.064456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f7d6-6c51-4e6f-aa66-147b3913661b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.078274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-21537a4a-836a-4eac-90b1-6638a1f1b936 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.081090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-21537a4a-836a-4eac-90b1-6638a1f1b936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.169473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 783/1552] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:47 2022] PUT /identity/v3/projects/b5758d6346314cb3bac448b4b052e32c/users/a491d60bff954b48ac0d3333ea77643b/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:47.169473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f7d6-6c51-4e6f-aa66-147b3913661b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.173521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 770/1553] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.179147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fcc71-1ac9-49b4-a067-886fb35444cb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.179147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fcc71-1ac9-49b4-a067-886fb35444cb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.179147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fcc71-1ac9-49b4-a067-886fb35444cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.200463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f79fcc71-1ac9-49b4-a067-886fb35444cb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.213275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f79fcc71-1ac9-49b4-a067-886fb35444cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.236718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:47.253226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f7d6-6c51-4e6f-aa66-147b3913661b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.255739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec154c0-98c2-40e3-bc02-6742f8f068e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.256388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec154c0-98c2-40e3-bc02-6742f8f068e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.256665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec154c0-98c2-40e3-bc02-6742f8f068e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.256941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec154c0-98c2-40e3-bc02-6742f8f068e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.257683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec154c0-98c2-40e3-bc02-6742f8f068e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.259611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec154c0-98c2-40e3-bc02-6742f8f068e0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.264813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 771/1554] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.266256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffc83-b7c8-45f3-8f47-2ed9d3d715ac None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.266541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffc83-b7c8-45f3-8f47-2ed9d3d715ac None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.266817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffc83-b7c8-45f3-8f47-2ed9d3d715ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.286815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1beffc83-b7c8-45f3-8f47-2ed9d3d715ac None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.288024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1beffc83-b7c8-45f3-8f47-2ed9d3d715ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.296701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 772/1555] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.297908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c89c2-e9bb-4562-8472-f18b55fe6624 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.298196 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c89c2-e9bb-4562-8472-f18b55fe6624 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.298469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c89c2-e9bb-4562-8472-f18b55fe6624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.318179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e59c89c2-e9bb-4562-8472-f18b55fe6624 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.319468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e59c89c2-e9bb-4562-8472-f18b55fe6624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.327431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 773/1556] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.328635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da904e-d528-41d3-8538-ff01ae42a707 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.333701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da904e-d528-41d3-8538-ff01ae42a707 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.333701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da904e-d528-41d3-8538-ff01ae42a707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.350579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-35da904e-d528-41d3-8538-ff01ae42a707 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.351826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-35da904e-d528-41d3-8538-ff01ae42a707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.360386 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 774/1557] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.361242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da904e-d528-41d3-8538-ff01ae42a707 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.370697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da904e-d528-41d3-8538-ff01ae42a707 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.375403 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07782c-78d0-46fb-b113-26007773419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.376003 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07782c-78d0-46fb-b113-26007773419d admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.376285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07782c-78d0-46fb-b113-26007773419d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.376560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07782c-78d0-46fb-b113-26007773419d admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.377280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07782c-78d0-46fb-b113-26007773419d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:47.377583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07782c-78d0-46fb-b113-26007773419d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.379189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07782c-78d0-46fb-b113-26007773419d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.390750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 775/1558] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:47.396699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd839f-7d1c-4193-b464-134278797542 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.396699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd839f-7d1c-4193-b464-134278797542 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.396699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd839f-7d1c-4193-b464-134278797542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.419535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:47.428892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0edd839f-7d1c-4193-b464-134278797542 None None] MFA Rules not processed for user `a491d60bff954b48ac0d3333ea77643b`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.428892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0edd839f-7d1c-4193-b464-134278797542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.429164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 784/1559] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:47.429164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b3ef-3c1b-4118-bce2-0ee9076ee457 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.429164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b3ef-3c1b-4118-bce2-0ee9076ee457 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.429164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b3ef-3c1b-4118-bce2-0ee9076ee457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.446710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-83d2b3ef-3c1b-4118-bce2-0ee9076ee457 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.447899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-83d2b3ef-3c1b-4118-bce2-0ee9076ee457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.456743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 785/1560] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.457988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7cfb9-39c7-451c-819c-8c0b448d8bc1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.458269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7cfb9-39c7-451c-819c-8c0b448d8bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.458547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7cfb9-39c7-451c-819c-8c0b448d8bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.478035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0cd7cfb9-39c7-451c-819c-8c0b448d8bc1 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.479254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0cd7cfb9-39c7-451c-819c-8c0b448d8bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.487424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 786/1561] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.488620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6dbe7-0a90-46a1-8268-0b4d246177dd None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.488910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6dbe7-0a90-46a1-8268-0b4d246177dd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.489204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6dbe7-0a90-46a1-8268-0b4d246177dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.497009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 776/1562] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.497009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62187a1-dd60-408d-af08-dbc42213d4a2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.497009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62187a1-dd60-408d-af08-dbc42213d4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.497009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62187a1-dd60-408d-af08-dbc42213d4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.515167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e62187a1-dd60-408d-af08-dbc42213d4a2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.516307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e62187a1-dd60-408d-af08-dbc42213d4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.519667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-42b6dbe7-0a90-46a1-8268-0b4d246177dd None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.521994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-42b6dbe7-0a90-46a1-8268-0b4d246177dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.524710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 777/1563] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.526081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3b2da-5e42-4bc2-8d72-d1c43349ac89 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.526266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3b2da-5e42-4bc2-8d72-d1c43349ac89 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.526561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3b2da-5e42-4bc2-8d72-d1c43349ac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.534237 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 787/1564] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.535473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6dbe7-0a90-46a1-8268-0b4d246177dd None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.546970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6dbe7-0a90-46a1-8268-0b4d246177dd None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.547306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-76a3b2da-5e42-4bc2-8d72-d1c43349ac89 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.553325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-76a3b2da-5e42-4bc2-8d72-d1c43349ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.553444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87af61f-72d8-48f7-a66e-2ed694ea0b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.553444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af61f-72d8-48f7-a66e-2ed694ea0b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.553444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af61f-72d8-48f7-a66e-2ed694ea0b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.553444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af61f-72d8-48f7-a66e-2ed694ea0b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.553796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87af61f-72d8-48f7-a66e-2ed694ea0b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.554461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-a87af61f-72d8-48f7-a66e-2ed694ea0b71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:03:47.554461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jul 25 23:03:47.554461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: Jul 25 23:03:47.555660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87af61f-72d8-48f7-a66e-2ed694ea0b71 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.556789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 778/1565] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.557463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3b2da-5e42-4bc2-8d72-d1c43349ac89 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.567547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3b2da-5e42-4bc2-8d72-d1c43349ac89 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.573455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc5bcf-dbf9-4502-a157-ea62c7301e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.574614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc5bcf-dbf9-4502-a157-ea62c7301e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.574894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc5bcf-dbf9-4502-a157-ea62c7301e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.575166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc5bcf-dbf9-4502-a157-ea62c7301e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.575909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc5bcf-dbf9-4502-a157-ea62c7301e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.577592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc5bcf-dbf9-4502-a157-ea62c7301e97 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.587980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 779/1566] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:47.589309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac936-7869-4b73-ad18-9c71c8449fc0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.589627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac936-7869-4b73-ad18-9c71c8449fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.590822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac936-7869-4b73-ad18-9c71c8449fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.610462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-862ac936-7869-4b73-ad18-9c71c8449fc0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.611662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-862ac936-7869-4b73-ad18-9c71c8449fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.619466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 780/1567] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.620231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac936-7869-4b73-ad18-9c71c8449fc0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.630361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac936-7869-4b73-ad18-9c71c8449fc0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.632586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 788/1568] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:47.632586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bddc0d-ef8f-4881-9d39-042716b9a4a9 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.632921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bddc0d-ef8f-4881-9d39-042716b9a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.633238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bddc0d-ef8f-4881-9d39-042716b9a4a9 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.637295 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 789/1569] 10.222.0.55 () {54 vars in 962 bytes} [Mon Jul 25 23:03:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:47.638753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bddc0d-ef8f-4881-9d39-042716b9a4a9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.691501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ea27c-e849-443b-ad09-e9f83580bf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.692127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ea27c-e849-443b-ad09-e9f83580bf72 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.692408 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ea27c-e849-443b-ad09-e9f83580bf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.692679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ea27c-e849-443b-ad09-e9f83580bf72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.693399 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ea27c-e849-443b-ad09-e9f83580bf72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:47.693779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ea27c-e849-443b-ad09-e9f83580bf72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.695380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ea27c-e849-443b-ad09-e9f83580bf72 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.702955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:47.707671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bddc0d-ef8f-4881-9d39-042716b9a4a9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.707814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 781/1570] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:47.708617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ea27c-e849-443b-ad09-e9f83580bf72 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.719119 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ea27c-e849-443b-ad09-e9f83580bf72 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.719966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ea183-28dd-4354-bd4e-196be19b2afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.720604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ea183-28dd-4354-bd4e-196be19b2afe admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.720891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ea183-28dd-4354-bd4e-196be19b2afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.721197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ea183-28dd-4354-bd4e-196be19b2afe admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.722015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ea183-28dd-4354-bd4e-196be19b2afe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:47.722445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ea183-28dd-4354-bd4e-196be19b2afe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.723759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58d57c-3ade-41a5-b96d-4fd45d088d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.723990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ea183-28dd-4354-bd4e-196be19b2afe admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.724546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58d57c-3ade-41a5-b96d-4fd45d088d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.724804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58d57c-3ade-41a5-b96d-4fd45d088d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.725076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58d57c-3ade-41a5-b96d-4fd45d088d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.725791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58d57c-3ade-41a5-b96d-4fd45d088d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:47.726091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58d57c-3ade-41a5-b96d-4fd45d088d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.727668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58d57c-3ade-41a5-b96d-4fd45d088d4c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.736899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 790/1571] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:47.737730 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ea183-28dd-4354-bd4e-196be19b2afe admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.747641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ea183-28dd-4354-bd4e-196be19b2afe admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.754168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 782/1572] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:47.754168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58d57c-3ade-41a5-b96d-4fd45d088d4c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.758454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aef5b8-f0d6-4906-9227-27a66d6ccba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.758920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58d57c-3ade-41a5-b96d-4fd45d088d4c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.759076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aef5b8-f0d6-4906-9227-27a66d6ccba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.759357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aef5b8-f0d6-4906-9227-27a66d6ccba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.759633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aef5b8-f0d6-4906-9227-27a66d6ccba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.760404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aef5b8-f0d6-4906-9227-27a66d6ccba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:47.760655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aef5b8-f0d6-4906-9227-27a66d6ccba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.763025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aef5b8-f0d6-4906-9227-27a66d6ccba7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.764788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46360736-a83e-4abc-a770-53b4bc9ae5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.765653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46360736-a83e-4abc-a770-53b4bc9ae5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.766520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46360736-a83e-4abc-a770-53b4bc9ae5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.766803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46360736-a83e-4abc-a770-53b4bc9ae5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.767498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46360736-a83e-4abc-a770-53b4bc9ae5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.769128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46360736-a83e-4abc-a770-53b4bc9ae5a3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.775315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 791/1573] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:47.776290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aef5b8-f0d6-4906-9227-27a66d6ccba7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.780095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 783/1574] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:47.780802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46360736-a83e-4abc-a770-53b4bc9ae5a3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.791214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46360736-a83e-4abc-a770-53b4bc9ae5a3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.792399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aef5b8-f0d6-4906-9227-27a66d6ccba7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.795937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c3c26-e1c1-495c-8015-1664a33c18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.796573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c3c26-e1c1-495c-8015-1664a33c18b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.796855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c3c26-e1c1-495c-8015-1664a33c18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.797155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c3c26-e1c1-495c-8015-1664a33c18b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.797354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e390f-ec96-4095-acdf-d9a9c4dbde41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.797820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c3c26-e1c1-495c-8015-1664a33c18b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.797988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e390f-ec96-4095-acdf-d9a9c4dbde41 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.798249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e390f-ec96-4095-acdf-d9a9c4dbde41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.798524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e390f-ec96-4095-acdf-d9a9c4dbde41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.798972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-2e5c3c26-e1c1-495c-8015-1664a33c18b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:03:47.798972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jul 25 23:03:47.798972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: Jul 25 23:03:47.799231 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e390f-ec96-4095-acdf-d9a9c4dbde41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:47.799511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e390f-ec96-4095-acdf-d9a9c4dbde41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.800258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c3c26-e1c1-495c-8015-1664a33c18b9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.801105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e390f-ec96-4095-acdf-d9a9c4dbde41 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.814309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 792/1575] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:47.815724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e031a15-8088-4372-b31b-f0ce353c40db None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.816014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e031a15-8088-4372-b31b-f0ce353c40db None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.816291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e031a15-8088-4372-b31b-f0ce353c40db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.854667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2e031a15-8088-4372-b31b-f0ce353c40db None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:47.855961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2e031a15-8088-4372-b31b-f0ce353c40db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:47.879595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 784/1576] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:47.879595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c3c26-e1c1-495c-8015-1664a33c18b9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.888754 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c3c26-e1c1-495c-8015-1664a33c18b9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.893855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcdb34-1dd5-4537-97c1-4bf75e3bd6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.894489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcdb34-1dd5-4537-97c1-4bf75e3bd6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.894750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcdb34-1dd5-4537-97c1-4bf75e3bd6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.895046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcdb34-1dd5-4537-97c1-4bf75e3bd6c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.895693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcdb34-1dd5-4537-97c1-4bf75e3bd6c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.897661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcdb34-1dd5-4537-97c1-4bf75e3bd6c7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:47.927738 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 793/1577] 10.222.0.55 () {58 vars in 1059 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:47.928702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e031a15-8088-4372-b31b-f0ce353c40db None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:47.935519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:47.940247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e031a15-8088-4372-b31b-f0ce353c40db None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:47.945866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac74975-5ce8-4f90-9836-bfe61ccdf583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:47.949928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac74975-5ce8-4f90-9836-bfe61ccdf583 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:47.949928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac74975-5ce8-4f90-9836-bfe61ccdf583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:47.949928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac74975-5ce8-4f90-9836-bfe61ccdf583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:47.949928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac74975-5ce8-4f90-9836-bfe61ccdf583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:47.950250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac74975-5ce8-4f90-9836-bfe61ccdf583 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.028737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 785/1578] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:48.028737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcdb34-1dd5-4537-97c1-4bf75e3bd6c7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.058440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 794/1579] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:47 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:48.058440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac74975-5ce8-4f90-9836-bfe61ccdf583 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.091189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcdb34-1dd5-4537-97c1-4bf75e3bd6c7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.120658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac74975-5ce8-4f90-9836-bfe61ccdf583 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.125608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a638942-7cfd-45b0-9c55-ff3e9ead5105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.126276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a638942-7cfd-45b0-9c55-ff3e9ead5105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.126555 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a638942-7cfd-45b0-9c55-ff3e9ead5105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.126830 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a638942-7cfd-45b0-9c55-ff3e9ead5105 admin admin] PATH_INFO: `/v3/projects/d37d3446345749b28d847313e1e6c488/users/61d3b5a3082a4c74a2a08007581388c0/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.141412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a638942-7cfd-45b0-9c55-ff3e9ead5105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37d3446345749b28d847313e1e6c488, user_id=61d3b5a3082a4c74a2a08007581388c0, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.144015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a638942-7cfd-45b0-9c55-ff3e9ead5105 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.147813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b36b-0126-4c9a-9873-f307ba4c9612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.148438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b36b-0126-4c9a-9873-f307ba4c9612 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.148722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b36b-0126-4c9a-9873-f307ba4c9612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.149032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b36b-0126-4c9a-9873-f307ba4c9612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.149711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072b36b-0126-4c9a-9873-f307ba4c9612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.151620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072b36b-0126-4c9a-9873-f307ba4c9612 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.217919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 795/1580] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:48 2022] PUT /identity/v3/projects/d37d3446345749b28d847313e1e6c488/users/61d3b5a3082a4c74a2a08007581388c0/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:48.219480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a638942-7cfd-45b0-9c55-ff3e9ead5105 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.251291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 786/1581] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:48 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:48.251291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b36b-0126-4c9a-9873-f307ba4c9612 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.281712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:48.286107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a638942-7cfd-45b0-9c55-ff3e9ead5105 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.319941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b36b-0126-4c9a-9873-f307ba4c9612 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.325448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a8981-3670-4f09-a9da-81b6d0c2d2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.326116 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a8981-3670-4f09-a9da-81b6d0c2d2cc admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.326400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a8981-3670-4f09-a9da-81b6d0c2d2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.326677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a8981-3670-4f09-a9da-81b6d0c2d2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.327351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a8981-3670-4f09-a9da-81b6d0c2d2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.329325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a8981-3670-4f09-a9da-81b6d0c2d2cc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.348230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7b8f7-85c6-4cf8-868a-348dd9343650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.348859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7b8f7-85c6-4cf8-868a-348dd9343650 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.349165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7b8f7-85c6-4cf8-868a-348dd9343650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.349445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7b8f7-85c6-4cf8-868a-348dd9343650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.350121 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7b8f7-85c6-4cf8-868a-348dd9343650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.352134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7b8f7-85c6-4cf8-868a-348dd9343650 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.447775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 787/1582] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:48 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:48.448757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a8981-3670-4f09-a9da-81b6d0c2d2cc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.481581 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:48.489087 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 796/1583] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:48 2022] POST /identity/v3/projects => generated 375 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:48.490293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7b8f7-85c6-4cf8-868a-348dd9343650 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.512488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a8981-3670-4f09-a9da-81b6d0c2d2cc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.562092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7b8f7-85c6-4cf8-868a-348dd9343650 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.567738 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e791b0-4d44-4874-a2d4-17ce09925647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.568367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e791b0-4d44-4874-a2d4-17ce09925647 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.568649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e791b0-4d44-4874-a2d4-17ce09925647 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.568928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e791b0-4d44-4874-a2d4-17ce09925647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.572384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc7ddb-731e-4f79-839a-c4924a62f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.573013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc7ddb-731e-4f79-839a-c4924a62f856 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.573331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc7ddb-731e-4f79-839a-c4924a62f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.573613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc7ddb-731e-4f79-839a-c4924a62f856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.574995 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc7ddb-731e-4f79-839a-c4924a62f856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.576852 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc7ddb-731e-4f79-839a-c4924a62f856 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.586801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 788/1584] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:48.587574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc7ddb-731e-4f79-839a-c4924a62f856 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.597374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc7ddb-731e-4f79-839a-c4924a62f856 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.601899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d2174-3099-468d-be5a-798c189a5702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.602492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d2174-3099-468d-be5a-798c189a5702 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.602771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d2174-3099-468d-be5a-798c189a5702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.603046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d2174-3099-468d-be5a-798c189a5702 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.603702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d2174-3099-468d-be5a-798c189a5702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.605774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d2174-3099-468d-be5a-798c189a5702 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.631556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e791b0-4d44-4874-a2d4-17ce09925647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.633231 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e791b0-4d44-4874-a2d4-17ce09925647 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.643263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 797/1585] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:48.644077 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e791b0-4d44-4874-a2d4-17ce09925647 service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.654366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e791b0-4d44-4874-a2d4-17ce09925647 service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.659396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc5fe8-7a06-4e1a-94eb-0d91e49f8aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.661636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc5fe8-7a06-4e1a-94eb-0d91e49f8aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.661636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc5fe8-7a06-4e1a-94eb-0d91e49f8aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.661636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc5fe8-7a06-4e1a-94eb-0d91e49f8aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.661636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc5fe8-7a06-4e1a-94eb-0d91e49f8aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.663216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc5fe8-7a06-4e1a-94eb-0d91e49f8aa7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.689398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 789/1586] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:48 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:48.689398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4acd93-f0a2-4bc8-9a2f-9da164c1ac58 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.689398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4acd93-f0a2-4bc8-9a2f-9da164c1ac58 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.689398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4acd93-f0a2-4bc8-9a2f-9da164c1ac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.707523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2c4acd93-f0a2-4bc8-9a2f-9da164c1ac58 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:48.708770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2c4acd93-f0a2-4bc8-9a2f-9da164c1ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:48.716407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 790/1587] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:48.717180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4acd93-f0a2-4bc8-9a2f-9da164c1ac58 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.735152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4acd93-f0a2-4bc8-9a2f-9da164c1ac58 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.739846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77f57-87cb-4b36-858f-64b699d12c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.740460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77f57-87cb-4b36-858f-64b699d12c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.740743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77f57-87cb-4b36-858f-64b699d12c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.741019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77f57-87cb-4b36-858f-64b699d12c50 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.741763 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a77f57-87cb-4b36-858f-64b699d12c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.743708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a77f57-87cb-4b36-858f-64b699d12c50 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.760852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 798/1588] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:48 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:48.762565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc5fe8-7a06-4e1a-94eb-0d91e49f8aa7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.772857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc5fe8-7a06-4e1a-94eb-0d91e49f8aa7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.777609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8b94-b82b-4635-9c8b-2bcd6631015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.778218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8b94-b82b-4635-9c8b-2bcd6631015a admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.778499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8b94-b82b-4635-9c8b-2bcd6631015a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.778778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8b94-b82b-4635-9c8b-2bcd6631015a admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.779440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc8b94-b82b-4635-9c8b-2bcd6631015a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.781652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc8b94-b82b-4635-9c8b-2bcd6631015a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.853230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 791/1589] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:48 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:48.853230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77f57-87cb-4b36-858f-64b699d12c50 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.867249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77f57-87cb-4b36-858f-64b699d12c50 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.873236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d68a0-be0b-4d27-bc75-6c9633f23a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.874263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d68a0-be0b-4d27-bc75-6c9633f23a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.874263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d68a0-be0b-4d27-bc75-6c9633f23a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.874489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d68a0-be0b-4d27-bc75-6c9633f23a63 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.875184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d68a0-be0b-4d27-bc75-6c9633f23a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.877477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d68a0-be0b-4d27-bc75-6c9633f23a63 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.889730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:48.899236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 799/1590] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:48 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:48.900272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8b94-b82b-4635-9c8b-2bcd6631015a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.910718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8b94-b82b-4635-9c8b-2bcd6631015a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.915500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f5c46-f3cf-4ac6-8c65-a545bb518a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.916177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5c46-f3cf-4ac6-8c65-a545bb518a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.916491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5c46-f3cf-4ac6-8c65-a545bb518a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.916832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5c46-f3cf-4ac6-8c65-a545bb518a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.917632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f5c46-f3cf-4ac6-8c65-a545bb518a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.919834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f5c46-f3cf-4ac6-8c65-a545bb518a19 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.930810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 800/1591] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:48.936383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f5c46-f3cf-4ac6-8c65-a545bb518a19 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.943074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f5c46-f3cf-4ac6-8c65-a545bb518a19 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.947715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88e0bd-4569-460b-97d4-c6eff171289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.948320 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88e0bd-4569-460b-97d4-c6eff171289e admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.948609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88e0bd-4569-460b-97d4-c6eff171289e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.948937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88e0bd-4569-460b-97d4-c6eff171289e admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.949645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88e0bd-4569-460b-97d4-c6eff171289e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.951273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88e0bd-4569-460b-97d4-c6eff171289e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.960510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 792/1592] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:48 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:48.961787 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d68a0-be0b-4d27-bc75-6c9633f23a63 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.965477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 801/1593] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:48.965477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88e0bd-4569-460b-97d4-c6eff171289e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:48.975797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88e0bd-4569-460b-97d4-c6eff171289e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:48.981728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479b1fc-db03-46be-9f6a-bf150932d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:48.982587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479b1fc-db03-46be-9f6a-bf150932d5ef admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:48.983051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479b1fc-db03-46be-9f6a-bf150932d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:48.983492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479b1fc-db03-46be-9f6a-bf150932d5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:48.984346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479b1fc-db03-46be-9f6a-bf150932d5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:48.986201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479b1fc-db03-46be-9f6a-bf150932d5ef admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:48.998078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 802/1594] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:48.999028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479b1fc-db03-46be-9f6a-bf150932d5ef admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.013362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479b1fc-db03-46be-9f6a-bf150932d5ef admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.018417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a484d-47a7-446b-b10b-8f7a4045154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.018994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a484d-47a7-446b-b10b-8f7a4045154f admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.019227 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a484d-47a7-446b-b10b-8f7a4045154f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.019538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a484d-47a7-446b-b10b-8f7a4045154f admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.020424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a484d-47a7-446b-b10b-8f7a4045154f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.022157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a484d-47a7-446b-b10b-8f7a4045154f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.028136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d68a0-be0b-4d27-bc75-6c9633f23a63 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.032070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367bbbb-1239-454f-89b9-42160a75e2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.032684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367bbbb-1239-454f-89b9-42160a75e2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.032986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367bbbb-1239-454f-89b9-42160a75e2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.033256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367bbbb-1239-454f-89b9-42160a75e2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.033657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 803/1595] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:49.034486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a484d-47a7-446b-b10b-8f7a4045154f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.045277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a484d-47a7-446b-b10b-8f7a4045154f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.048075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367bbbb-1239-454f-89b9-42160a75e2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.049575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367bbbb-1239-454f-89b9-42160a75e2e4 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.049847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f9df-1cde-4ee7-b49b-2a59367434e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.050582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f9df-1cde-4ee7-b49b-2a59367434e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.050975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f9df-1cde-4ee7-b49b-2a59367434e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.051390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f9df-1cde-4ee7-b49b-2a59367434e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.052099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0f9df-1cde-4ee7-b49b-2a59367434e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.053711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0f9df-1cde-4ee7-b49b-2a59367434e4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.060722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 793/1596] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:49.066081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 804/1597] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:49.069407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f9df-1cde-4ee7-b49b-2a59367434e4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.069795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367bbbb-1239-454f-89b9-42160a75e2e4 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.077500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:49.082962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367bbbb-1239-454f-89b9-42160a75e2e4 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.084536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f9df-1cde-4ee7-b49b-2a59367434e4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.088374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309cf90-bd76-4d8f-8576-7a693f4bb9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.089229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309cf90-bd76-4d8f-8576-7a693f4bb9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.090988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309cf90-bd76-4d8f-8576-7a693f4bb9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.090988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309cf90-bd76-4d8f-8576-7a693f4bb9b1 admin admin] PATH_INFO: `/v3/projects/e3154bd58b544d0d857e5b3918783cc9/users/20625ee0dcb0427183ad6f9865ff5764/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.091330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28ec0-043f-4673-91f3-60e564794f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.092152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28ec0-043f-4673-91f3-60e564794f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.092739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28ec0-043f-4673-91f3-60e564794f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.093200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28ec0-043f-4673-91f3-60e564794f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.095508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed28ec0-043f-4673-91f3-60e564794f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.104776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed28ec0-043f-4673-91f3-60e564794f82 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.119040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309cf90-bd76-4d8f-8576-7a693f4bb9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3154bd58b544d0d857e5b3918783cc9, user_id=20625ee0dcb0427183ad6f9865ff5764, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.119040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309cf90-bd76-4d8f-8576-7a693f4bb9b1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.127537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 805/1598] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:49.128477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28ec0-043f-4673-91f3-60e564794f82 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.139537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28ec0-043f-4673-91f3-60e564794f82 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.144319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd8943-9714-40e4-804c-5df5a69b2710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.144933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8943-9714-40e4-804c-5df5a69b2710 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.145268 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8943-9714-40e4-804c-5df5a69b2710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.145548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8943-9714-40e4-804c-5df5a69b2710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.146248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd8943-9714-40e4-804c-5df5a69b2710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.147863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd8943-9714-40e4-804c-5df5a69b2710 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.159483 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 806/1599] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:49.160930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd8943-9714-40e4-804c-5df5a69b2710 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.172525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd8943-9714-40e4-804c-5df5a69b2710 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.177714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfebbc7-bb6e-4350-a03e-a113fa248b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.178417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfebbc7-bb6e-4350-a03e-a113fa248b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.178708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfebbc7-bb6e-4350-a03e-a113fa248b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.178989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfebbc7-bb6e-4350-a03e-a113fa248b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.179699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfebbc7-bb6e-4350-a03e-a113fa248b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.181380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfebbc7-bb6e-4350-a03e-a113fa248b70 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.196540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 807/1600] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:49.196540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfebbc7-bb6e-4350-a03e-a113fa248b70 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.196935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 794/1601] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:49 2022] PUT /identity/v3/projects/e3154bd58b544d0d857e5b3918783cc9/users/20625ee0dcb0427183ad6f9865ff5764/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:49.197898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309cf90-bd76-4d8f-8576-7a693f4bb9b1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.210982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfebbc7-bb6e-4350-a03e-a113fa248b70 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.269060 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309cf90-bd76-4d8f-8576-7a693f4bb9b1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.272955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf61c46-c89c-49c9-a217-14efc868a3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.273632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf61c46-c89c-49c9-a217-14efc868a3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.273780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905ec41-f9fd-4b6e-868a-892a60007335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.273922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf61c46-c89c-49c9-a217-14efc868a3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.274174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf61c46-c89c-49c9-a217-14efc868a3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.274449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905ec41-f9fd-4b6e-868a-892a60007335 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.274742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905ec41-f9fd-4b6e-868a-892a60007335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.274869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf61c46-c89c-49c9-a217-14efc868a3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.275024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905ec41-f9fd-4b6e-868a-892a60007335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.276033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905ec41-f9fd-4b6e-868a-892a60007335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.276477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf61c46-c89c-49c9-a217-14efc868a3b2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.278477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905ec41-f9fd-4b6e-868a-892a60007335 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.287926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 808/1602] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:49.288892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf61c46-c89c-49c9-a217-14efc868a3b2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.292371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 795/1603] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:49.292371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905ec41-f9fd-4b6e-868a-892a60007335 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.300970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf61c46-c89c-49c9-a217-14efc868a3b2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.301752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905ec41-f9fd-4b6e-868a-892a60007335 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.305966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b593574-5e8e-4d16-9df8-f7518edfc7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.306821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11cd91-48dc-4b23-a5ad-bb020cea281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.306939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b593574-5e8e-4d16-9df8-f7518edfc7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.307042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b593574-5e8e-4d16-9df8-f7518edfc7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.307288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11cd91-48dc-4b23-a5ad-bb020cea281d admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.307420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b593574-5e8e-4d16-9df8-f7518edfc7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.307554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11cd91-48dc-4b23-a5ad-bb020cea281d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.307822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11cd91-48dc-4b23-a5ad-bb020cea281d admin admin] PATH_INFO: `/v3/projects/c1eaeb0edc7741b09bb3c0ade2421aa9/users/589af27027794611b803a8577f9e4649/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.308012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b593574-5e8e-4d16-9df8-f7518edfc7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.311276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b593574-5e8e-4d16-9df8-f7518edfc7c6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.324842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 809/1604] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:49.324842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fcf14-41c7-40da-bbec-1e902a43148e None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.324842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fcf14-41c7-40da-bbec-1e902a43148e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.324842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fcf14-41c7-40da-bbec-1e902a43148e None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.325762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 810/1605] 10.222.0.55 () {54 vars in 962 bytes} [Mon Jul 25 23:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:49.326731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fcf14-41c7-40da-bbec-1e902a43148e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.327392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11cd91-48dc-4b23-a5ad-bb020cea281d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1eaeb0edc7741b09bb3c0ade2421aa9, user_id=589af27027794611b803a8577f9e4649, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.332518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11cd91-48dc-4b23-a5ad-bb020cea281d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.340604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fcf14-41c7-40da-bbec-1e902a43148e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.345702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8975f-8766-49b0-9a8b-d1315c57143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.346391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8975f-8766-49b0-9a8b-d1315c57143d admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.346708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8975f-8766-49b0-9a8b-d1315c57143d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.347069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8975f-8766-49b0-9a8b-d1315c57143d admin admin] PATH_INFO: `/v3/projects/4dc09d2e90f0483c8cc393c9b4d2d90c/users/3c9720b2eace46ab9909227a9f8f3755/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.365143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8975f-8766-49b0-9a8b-d1315c57143d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc09d2e90f0483c8cc393c9b4d2d90c, user_id=3c9720b2eace46ab9909227a9f8f3755, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.367977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8975f-8766-49b0-9a8b-d1315c57143d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.430041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 796/1606] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:49 2022] PUT /identity/v3/projects/c1eaeb0edc7741b09bb3c0ade2421aa9/users/589af27027794611b803a8577f9e4649/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:49.431366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3a8c-a41a-49f3-a66a-52a1719301cf None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.431651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3a8c-a41a-49f3-a66a-52a1719301cf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.431923 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3a8c-a41a-49f3-a66a-52a1719301cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.454728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d4cf3a8c-a41a-49f3-a66a-52a1719301cf None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:49.456573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d4cf3a8c-a41a-49f3-a66a-52a1719301cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:49.460310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 811/1607] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:49 2022] PUT /identity/v3/projects/4dc09d2e90f0483c8cc393c9b4d2d90c/users/3c9720b2eace46ab9909227a9f8f3755/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:49.461312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8975f-8766-49b0-9a8b-d1315c57143d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.506848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:49.527640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 797/1608] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:49.528848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf3a8c-a41a-49f3-a66a-52a1719301cf None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.533196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8975f-8766-49b0-9a8b-d1315c57143d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.538173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f372-58b4-4dcd-8868-f68a8a30aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.538936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f372-58b4-4dcd-8868-f68a8a30aafc admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.539231 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f372-58b4-4dcd-8868-f68a8a30aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.539524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f372-58b4-4dcd-8868-f68a8a30aafc admin admin] PATH_INFO: `/v3/projects/5d3254035db24cdd8100a97407aad11b/users/a06b78b123714677897220d34d46b5e7/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.546559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf3a8c-a41a-49f3-a66a-52a1719301cf None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.551606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2693fa-7b48-4ecc-aa38-1aa8f0ce7f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.552402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2693fa-7b48-4ecc-aa38-1aa8f0ce7f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.552561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2693fa-7b48-4ecc-aa38-1aa8f0ce7f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.552834 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2693fa-7b48-4ecc-aa38-1aa8f0ce7f18 admin admin] PATH_INFO: `/v3/projects/16a417bb74d445f7b2240ccb27061f05/users/fbc4fc1f207c4726b9c05b6b338f0e9c/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.557334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f372-58b4-4dcd-8868-f68a8a30aafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3254035db24cdd8100a97407aad11b, user_id=a06b78b123714677897220d34d46b5e7, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.560377 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f372-58b4-4dcd-8868-f68a8a30aafc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.568478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2693fa-7b48-4ecc-aa38-1aa8f0ce7f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a417bb74d445f7b2240ccb27061f05, user_id=fbc4fc1f207c4726b9c05b6b338f0e9c, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.571326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2693fa-7b48-4ecc-aa38-1aa8f0ce7f18 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.659664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 812/1609] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:49 2022] PUT /identity/v3/projects/5d3254035db24cdd8100a97407aad11b/users/a06b78b123714677897220d34d46b5e7/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:49.660500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f372-58b4-4dcd-8868-f68a8a30aafc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.679314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 798/1610] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:49 2022] PUT /identity/v3/projects/16a417bb74d445f7b2240ccb27061f05/users/fbc4fc1f207c4726b9c05b6b338f0e9c/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:49.680582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c113-6ff0-4ca1-8d45-3a28de3067d7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.680899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c113-6ff0-4ca1-8d45-3a28de3067d7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.681168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c113-6ff0-4ca1-8d45-3a28de3067d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.689973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:49.706920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-54a6c113-6ff0-4ca1-8d45-3a28de3067d7 None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:49.708305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-54a6c113-6ff0-4ca1-8d45-3a28de3067d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:49.750290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f372-58b4-4dcd-8868-f68a8a30aafc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:49.796710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 799/1611] 10.222.0.55 () {58 vars in 1059 bytes} [Mon Jul 25 23:03:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:49.798225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc691a-a04d-4f6d-988b-450b807e6a05 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.799311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc691a-a04d-4f6d-988b-450b807e6a05 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.799594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc691a-a04d-4f6d-988b-450b807e6a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.818020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b56d4-03e6-424f-ada0-aec26c840337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:49.821980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b56d4-03e6-424f-ada0-aec26c840337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.821980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b56d4-03e6-424f-ada0-aec26c840337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.821980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b56d4-03e6-424f-ada0-aec26c840337 admin admin] PATH_INFO: `/v3/projects/f0c3fc0630dd4083bcc8a9f70af99463/users/4eea5a29c87d431299b220e404fd5732/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.829714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2ecc691a-a04d-4f6d-988b-450b807e6a05 None None] MFA Rules not processed for user `589af27027794611b803a8577f9e4649`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:49.831767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2ecc691a-a04d-4f6d-988b-450b807e6a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:49.842183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b56d4-03e6-424f-ada0-aec26c840337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c3fc0630dd4083bcc8a9f70af99463, user_id=4eea5a29c87d431299b220e404fd5732, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:49.845160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b56d4-03e6-424f-ada0-aec26c840337 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:49.917498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 800/1612] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:49.917498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a356ddf-b675-460f-a6b8-14923d74ffb5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:49.917498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a356ddf-b675-460f-a6b8-14923d74ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:49.917498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a356ddf-b675-460f-a6b8-14923d74ffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:49.922473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 813/1613] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:49 2022] PUT /identity/v3/projects/f0c3fc0630dd4083bcc8a9f70af99463/users/4eea5a29c87d431299b220e404fd5732/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:49.923732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b56d4-03e6-424f-ada0-aec26c840337 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:49.928208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8d6b56d4-03e6-424f-ada0-aec26c840337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:49.951706 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3a356ddf-b675-460f-a6b8-14923d74ffb5 None None] MFA Rules not processed for user `3c9720b2eace46ab9909227a9f8f3755`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:49.953354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3a356ddf-b675-460f-a6b8-14923d74ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:49.994201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:50.001698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b56d4-03e6-424f-ada0-aec26c840337 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.005557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842834e-9f9c-4ca7-a820-fa3a933d4a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.006319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842834e-9f9c-4ca7-a820-fa3a933d4a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.006596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842834e-9f9c-4ca7-a820-fa3a933d4a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.006874 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842834e-9f9c-4ca7-a820-fa3a933d4a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.033530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 801/1614] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:50.038246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e91c3-3c52-44f8-ae45-be5135e40ccc None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.038542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e91c3-3c52-44f8-ae45-be5135e40ccc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.038888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e91c3-3c52-44f8-ae45-be5135e40ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.069223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c40e91c3-3c52-44f8-ae45-be5135e40ccc None None] MFA Rules not processed for user `a06b78b123714677897220d34d46b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:50.070461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c40e91c3-3c52-44f8-ae45-be5135e40ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:50.078013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:50.081147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842834e-9f9c-4ca7-a820-fa3a933d4a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.083252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842834e-9f9c-4ca7-a820-fa3a933d4a69 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.094164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 814/1615] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:50.095560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc770-9677-4959-8ca1-0731bc306e74 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.095880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc770-9677-4959-8ca1-0731bc306e74 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.096206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc770-9677-4959-8ca1-0731bc306e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.116336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-753cc770-9677-4959-8ca1-0731bc306e74 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:50.117618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-753cc770-9677-4959-8ca1-0731bc306e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:50.129191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 815/1616] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:50.130743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6bccd-2ebb-4930-98f1-19a47141df4b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.131038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6bccd-2ebb-4930-98f1-19a47141df4b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.131309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6bccd-2ebb-4930-98f1-19a47141df4b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.132804 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 816/1617] 10.222.0.55 () {54 vars in 912 bytes} [Mon Jul 25 23:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:50.138585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6bccd-2ebb-4930-98f1-19a47141df4b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.153041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6bccd-2ebb-4930-98f1-19a47141df4b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.155897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 802/1618] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:50.157266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07841ae6-2914-4b42-8ea5-499e02dec1ca None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.162003 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07841ae6-2914-4b42-8ea5-499e02dec1ca None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.162003 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07841ae6-2914-4b42-8ea5-499e02dec1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.162322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b50327-d2ac-4c13-be23-45673bbe3b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.163325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50327-d2ac-4c13-be23-45673bbe3b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.164433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50327-d2ac-4c13-be23-45673bbe3b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.165359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50327-d2ac-4c13-be23-45673bbe3b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.167040 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b50327-d2ac-4c13-be23-45673bbe3b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.171073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b50327-d2ac-4c13-be23-45673bbe3b68 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.186265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-07841ae6-2914-4b42-8ea5-499e02dec1ca None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:50.188428 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-07841ae6-2914-4b42-8ea5-499e02dec1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:50.198038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 803/1619] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:50.199000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07841ae6-2914-4b42-8ea5-499e02dec1ca None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.211137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07841ae6-2914-4b42-8ea5-499e02dec1ca None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.219968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f8f63-23d2-420f-873b-d8d9d1723cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.220707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f8f63-23d2-420f-873b-d8d9d1723cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.221028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f8f63-23d2-420f-873b-d8d9d1723cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.221364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f8f63-23d2-420f-873b-d8d9d1723cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.222247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f8f63-23d2-420f-873b-d8d9d1723cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.224318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f8f63-23d2-420f-873b-d8d9d1723cb5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.398238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 817/1620] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:50 2022] POST /identity/v3/projects => generated 381 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:50.399736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b85947-8a37-4bf7-b178-1780aa2eccfc None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.400133 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b85947-8a37-4bf7-b178-1780aa2eccfc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.400474 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b85947-8a37-4bf7-b178-1780aa2eccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.401136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 804/1621] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:50 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:50.402260 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f8f63-23d2-420f-873b-d8d9d1723cb5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.424940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-60b85947-8a37-4bf7-b178-1780aa2eccfc None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:50.426232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-60b85947-8a37-4bf7-b178-1780aa2eccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:50.476213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f8f63-23d2-420f-873b-d8d9d1723cb5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.480588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f1a21-d70f-4363-9a8d-f35d75dadfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.481575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f1a21-d70f-4363-9a8d-f35d75dadfad service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.481716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f1a21-d70f-4363-9a8d-f35d75dadfad service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.481946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f1a21-d70f-4363-9a8d-f35d75dadfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.500676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 818/1622] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:03:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:50.506198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b85947-8a37-4bf7-b178-1780aa2eccfc None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.514893 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b85947-8a37-4bf7-b178-1780aa2eccfc None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.520746 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44581a-47c1-4e7e-baa8-853c80ca2035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.521412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44581a-47c1-4e7e-baa8-853c80ca2035 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.521697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44581a-47c1-4e7e-baa8-853c80ca2035 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.521983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44581a-47c1-4e7e-baa8-853c80ca2035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.533687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:50.551506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f1a21-d70f-4363-9a8d-f35d75dadfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.553592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f1a21-d70f-4363-9a8d-f35d75dadfad service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.564655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 805/1623] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:50.565659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f1a21-d70f-4363-9a8d-f35d75dadfad service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.575417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f1a21-d70f-4363-9a8d-f35d75dadfad service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.583637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74a312-64a6-45ab-bac4-529096ad006b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.584280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74a312-64a6-45ab-bac4-529096ad006b service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.584566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74a312-64a6-45ab-bac4-529096ad006b service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.584841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74a312-64a6-45ab-bac4-529096ad006b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.602681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44581a-47c1-4e7e-baa8-853c80ca2035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.605341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74a312-64a6-45ab-bac4-529096ad006b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.605877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44581a-47c1-4e7e-baa8-853c80ca2035 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.607519 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74a312-64a6-45ab-bac4-529096ad006b service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.631962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 806/1624] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:50.632996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 819/1625] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:50.634401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74a312-64a6-45ab-bac4-529096ad006b service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.645299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44581a-47c1-4e7e-baa8-853c80ca2035 service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.658014 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74a312-64a6-45ab-bac4-529096ad006b service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.666477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2694c-8389-4841-8c9b-b3e6eedaf247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.667319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2694c-8389-4841-8c9b-b3e6eedaf247 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.667669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2694c-8389-4841-8c9b-b3e6eedaf247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.668164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2694c-8389-4841-8c9b-b3e6eedaf247 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.668904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2694c-8389-4841-8c9b-b3e6eedaf247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.671465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2694c-8389-4841-8c9b-b3e6eedaf247 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.688633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44581a-47c1-4e7e-baa8-853c80ca2035 service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.691694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d7ac1-9fd8-426e-9950-da5848302f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.693226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7ac1-9fd8-426e-9950-da5848302f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.694309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7ac1-9fd8-426e-9950-da5848302f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.694756 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7ac1-9fd8-426e-9950-da5848302f38 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.695633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d7ac1-9fd8-426e-9950-da5848302f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.697641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d7ac1-9fd8-426e-9950-da5848302f38 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.774348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 807/1626] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:50 2022] POST /identity/v3/users => generated 297 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:50.775293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2694c-8389-4841-8c9b-b3e6eedaf247 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.820221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 820/1627] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:50 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:50.823014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a3f84-6b9b-44ca-bb2a-449a47b160cb None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.823561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a3f84-6b9b-44ca-bb2a-449a47b160cb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.824730 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a3f84-6b9b-44ca-bb2a-449a47b160cb None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.826245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 821/1628] 10.222.0.55 () {54 vars in 912 bytes} [Mon Jul 25 23:03:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:50.831887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a3f84-6b9b-44ca-bb2a-449a47b160cb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.859869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a3f84-6b9b-44ca-bb2a-449a47b160cb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.864061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2694c-8389-4841-8c9b-b3e6eedaf247 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.865095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4d66c-6efb-45f1-ac3d-1a3002dbaf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.866238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d66c-6efb-45f1-ac3d-1a3002dbaf29 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.866358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d66c-6efb-45f1-ac3d-1a3002dbaf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.866640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d66c-6efb-45f1-ac3d-1a3002dbaf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.867344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4d66c-6efb-45f1-ac3d-1a3002dbaf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.868527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934667ee-2e14-4cdf-add4-55c78f14b8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.869309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4d66c-6efb-45f1-ac3d-1a3002dbaf29 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.869427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934667ee-2e14-4cdf-add4-55c78f14b8ab service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.869909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934667ee-2e14-4cdf-add4-55c78f14b8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.871758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934667ee-2e14-4cdf-add4-55c78f14b8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.884317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 822/1629] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:50.885296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4d66c-6efb-45f1-ac3d-1a3002dbaf29 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.894345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934667ee-2e14-4cdf-add4-55c78f14b8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.896218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934667ee-2e14-4cdf-add4-55c78f14b8ab service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.898046 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4d66c-6efb-45f1-ac3d-1a3002dbaf29 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.904239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64238-8fb6-43a9-a396-b8774a73614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.904816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64238-8fb6-43a9-a396-b8774a73614d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.905097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64238-8fb6-43a9-a396-b8774a73614d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.906281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64238-8fb6-43a9-a396-b8774a73614d admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.907527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff64238-8fb6-43a9-a396-b8774a73614d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:50.909030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff64238-8fb6-43a9-a396-b8774a73614d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:50.925158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 823/1631] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:50.925158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef0cd1-ed4f-419f-a97c-3f863bf1778e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.925158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef0cd1-ed4f-419f-a97c-3f863bf1778e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.925158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef0cd1-ed4f-419f-a97c-3f863bf1778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.929904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 808/1631] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:50.929904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934667ee-2e14-4cdf-add4-55c78f14b8ab service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.963898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934667ee-2e14-4cdf-add4-55c78f14b8ab service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:50.966256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d9ef0cd1-ed4f-419f-a97c-3f863bf1778e None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:50.967778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d9ef0cd1-ed4f-419f-a97c-3f863bf1778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:50.974572 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5b328-6246-4628-a895-b0df7f030f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:50.977682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5b328-6246-4628-a895-b0df7f030f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:50.977983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5b328-6246-4628-a895-b0df7f030f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:50.979339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 824/1632] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:03:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:50.979801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5b328-6246-4628-a895-b0df7f030f4e admin admin] PATH_INFO: `/v3/projects/910e33210f434e2daad950dd7c368587/users/de81ab2b3e3f48018b3b3d3cc4d52fce/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:50.980671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef0cd1-ed4f-419f-a97c-3f863bf1778e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:50.993981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef0cd1-ed4f-419f-a97c-3f863bf1778e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:51.000672 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b613f-90a5-4327-8954-ad047f67ae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:51.004076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b613f-90a5-4327-8954-ad047f67ae94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:51.004076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b613f-90a5-4327-8954-ad047f67ae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:51.004076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b613f-90a5-4327-8954-ad047f67ae94 admin admin] PATH_INFO: `/v3/projects/479b4eaf255f49db8af7be2a7aeaabd3/users/842745dee2474b98b1e6056d2239f0e4/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:51.013960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:51.030136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5b328-6246-4628-a895-b0df7f030f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=910e33210f434e2daad950dd7c368587, user_id=de81ab2b3e3f48018b3b3d3cc4d52fce, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:51.034785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b613f-90a5-4327-8954-ad047f67ae94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479b4eaf255f49db8af7be2a7aeaabd3, user_id=842745dee2474b98b1e6056d2239f0e4, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:51.036825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5b328-6246-4628-a895-b0df7f030f4e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:51.038144 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b613f-90a5-4327-8954-ad047f67ae94 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:51.176008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 825/1633] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:50 2022] PUT /identity/v3/projects/479b4eaf255f49db8af7be2a7aeaabd3/users/842745dee2474b98b1e6056d2239f0e4/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:51.179536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b613f-90a5-4327-8954-ad047f67ae94 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:51.182604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 809/1634] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:50 2022] PUT /identity/v3/projects/910e33210f434e2daad950dd7c368587/users/de81ab2b3e3f48018b3b3d3cc4d52fce/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:51.184686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5b328-6246-4628-a895-b0df7f030f4e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:51.311221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b613f-90a5-4327-8954-ad047f67ae94 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:51.315966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5065-156b-4faa-b9c6-0ced0b80c8c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:51.316922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5065-156b-4faa-b9c6-0ced0b80c8c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:51.318501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5065-156b-4faa-b9c6-0ced0b80c8c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:51.318898 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5065-156b-4faa-b9c6-0ced0b80c8c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:51.373046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5b328-6246-4628-a895-b0df7f030f4e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:51.418774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:51.432961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c5065-156b-4faa-b9c6-0ced0b80c8c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:51.436512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c5065-156b-4faa-b9c6-0ced0b80c8c4 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:51.444094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7f9a2-9413-4b63-975d-ceaf50812e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:51.445883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7f9a2-9413-4b63-975d-ceaf50812e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:51.446332 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7f9a2-9413-4b63-975d-ceaf50812e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:51.446812 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7f9a2-9413-4b63-975d-ceaf50812e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:51.448210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7f9a2-9413-4b63-975d-ceaf50812e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:51.451141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7f9a2-9413-4b63-975d-ceaf50812e23 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:51.453267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 826/1635] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:51.454568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5065-156b-4faa-b9c6-0ced0b80c8c4 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:51.471728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 810/1636] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:51.471728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7f9a2-9413-4b63-975d-ceaf50812e23 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:51.472044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5065-156b-4faa-b9c6-0ced0b80c8c4 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:51.476549 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1215d-b172-4b10-a044-367b1239faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:51.477545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1215d-b172-4b10-a044-367b1239faf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:51.478047 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1215d-b172-4b10-a044-367b1239faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:51.479116 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1215d-b172-4b10-a044-367b1239faf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:51.479941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1215d-b172-4b10-a044-367b1239faf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:51.481824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1215d-b172-4b10-a044-367b1239faf4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:51.498627 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 827/1637] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:51.499057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7f9a2-9413-4b63-975d-ceaf50812e23 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:51.505326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1215d-b172-4b10-a044-367b1239faf4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:51.517932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:51.518600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:51.518886 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:51.519165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] PATH_INFO: `/v3/users/a491d60bff954b48ac0d3333ea77643b` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:51.520581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a491d60bff954b48ac0d3333ea77643b)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:51.522517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1215d-b172-4b10-a044-367b1239faf4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:51.525417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:51.535832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b8ae0-ea33-48f1-919a-4ec12f2c3333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:51.539263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8ae0-ea33-48f1-919a-4ec12f2c3333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:51.539987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8ae0-ea33-48f1-919a-4ec12f2c3333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:51.541486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8ae0-ea33-48f1-919a-4ec12f2c3333 admin admin] PATH_INFO: `/v3/projects/479b4eaf255f49db8af7be2a7aeaabd3/users/842745dee2474b98b1e6056d2239f0e4/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:51.548995 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b8ae0-ea33-48f1-919a-4ec12f2c3333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479b4eaf255f49db8af7be2a7aeaabd3, user_id=842745dee2474b98b1e6056d2239f0e4, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:51.557735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b8ae0-ea33-48f1-919a-4ec12f2c3333 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:51.845705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 828/1638] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:51 2022] PUT /identity/v3/projects/479b4eaf255f49db8af7be2a7aeaabd3/users/842745dee2474b98b1e6056d2239f0e4/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:51.845705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b8ae0-ea33-48f1-919a-4ec12f2c3333 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:51.845705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b8ae0-ea33-48f1-919a-4ec12f2c3333 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:51.845705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d329ab-9fcb-4d83-9af2-a9d65e1ba0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:51.848329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d329ab-9fcb-4d83-9af2-a9d65e1ba0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:51.848329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d329ab-9fcb-4d83-9af2-a9d65e1ba0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:51.848329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d329ab-9fcb-4d83-9af2-a9d65e1ba0a0 admin admin] PATH_INFO: `/v3/projects/910e33210f434e2daad950dd7c368587/users/de81ab2b3e3f48018b3b3d3cc4d52fce/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:51.848329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d329ab-9fcb-4d83-9af2-a9d65e1ba0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=910e33210f434e2daad950dd7c368587, user_id=de81ab2b3e3f48018b3b3d3cc4d52fce, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:51.848329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d329ab-9fcb-4d83-9af2-a9d65e1ba0a0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:51.859311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:51.859311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 829/1639] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:51 2022] PUT /identity/v3/projects/910e33210f434e2daad950dd7c368587/users/de81ab2b3e3f48018b3b3d3cc4d52fce/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:51.859311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e330e97-6699-4234-84ad-d694440d88f5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:51.859311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e330e97-6699-4234-84ad-d694440d88f5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:51.859311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e330e97-6699-4234-84ad-d694440d88f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:51.859311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5e330e97-6699-4234-84ad-d694440d88f5 None None] MFA Rules not processed for user `842745dee2474b98b1e6056d2239f0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:51.863572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5e330e97-6699-4234-84ad-d694440d88f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:51.913703 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a491d60bff954b48ac0d3333ea77643b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:51.914477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a491d60bff954b48ac0d3333ea77643b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:51.941789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 830/1640] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:51.941789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb397d-1cee-4f26-9c65-f05f290352b5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:51.941789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb397d-1cee-4f26-9c65-f05f290352b5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:51.941789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb397d-1cee-4f26-9c65-f05f290352b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:51.974202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-eadb397d-1cee-4f26-9c65-f05f290352b5 None None] MFA Rules not processed for user `de81ab2b3e3f48018b3b3d3cc4d52fce`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:51.975724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-eadb397d-1cee-4f26-9c65-f05f290352b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:52.066110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a491d60bff954b48ac0d3333ea77643b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:52.089157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 831/1641] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:52.090848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a491d60bff954b48ac0d3333ea77643b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:52.091664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb397d-1cee-4f26-9c65-f05f290352b5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:52.108891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-139628b0-2fa8-4c8b-8fb2-e83d0586ab27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a491d60bff954b48ac0d3333ea77643b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:52.127362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 811/1642] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:03:51 2022] DELETE /identity/v3/users/a491d60bff954b48ac0d3333ea77643b => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:52.138628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90e79-e866-4c79-8764-40e0cfe53eae None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:52.138922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90e79-e866-4c79-8764-40e0cfe53eae None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:52.139199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90e79-e866-4c79-8764-40e0cfe53eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:52.182294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a3e90e79-e866-4c79-8764-40e0cfe53eae None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:52.184181 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a3e90e79-e866-4c79-8764-40e0cfe53eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:52.224991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb397d-1cee-4f26-9c65-f05f290352b5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:52.278049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 812/1643] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:03:52.289227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e90e79-e866-4c79-8764-40e0cfe53eae None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:52.294109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a3e90e79-e866-4c79-8764-40e0cfe53eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:52.317267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1830283-1a7f-4578-b102-07ec48ee8984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:52.318258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830283-1a7f-4578-b102-07ec48ee8984 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:52.318591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830283-1a7f-4578-b102-07ec48ee8984 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:52.319099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830283-1a7f-4578-b102-07ec48ee8984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:52.322590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f1830283-1a7f-4578-b102-07ec48ee8984 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:52.410777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1830283-1a7f-4578-b102-07ec48ee8984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:52.412705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1830283-1a7f-4578-b102-07ec48ee8984 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:52.426432 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 832/1644] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:52.453137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e90e79-e866-4c79-8764-40e0cfe53eae None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:52.459280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cca2-e373-47fe-8fe9-9af99f3f50e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:52.459678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cca2-e373-47fe-8fe9-9af99f3f50e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:52.459983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cca2-e373-47fe-8fe9-9af99f3f50e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:52.460218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cca2-e373-47fe-8fe9-9af99f3f50e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:52.485344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265cca2-e373-47fe-8fe9-9af99f3f50e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:52.488150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265cca2-e373-47fe-8fe9-9af99f3f50e3 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:52.504184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 813/1645] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:03:52.544392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:52.575507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1830283-1a7f-4578-b102-07ec48ee8984 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:52.577978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f1830283-1a7f-4578-b102-07ec48ee8984 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:52.598850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1830283-1a7f-4578-b102-07ec48ee8984 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:52.612261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514a4d7-1cb7-4ea6-8adc-18cabc39770c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:52.613984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514a4d7-1cb7-4ea6-8adc-18cabc39770c service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:52.614468 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514a4d7-1cb7-4ea6-8adc-18cabc39770c service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:52.615543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514a4d7-1cb7-4ea6-8adc-18cabc39770c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:52.620024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a514a4d7-1cb7-4ea6-8adc-18cabc39770c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:52.852669 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514a4d7-1cb7-4ea6-8adc-18cabc39770c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:52.859085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514a4d7-1cb7-4ea6-8adc-18cabc39770c service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:52.890442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 833/1646] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:52.900710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:53.162417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cca2-e373-47fe-8fe9-9af99f3f50e3 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:53.197642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cca2-e373-47fe-8fe9-9af99f3f50e3 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:53.203261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545503b-6d2a-497a-a67e-2e2a57787548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:53.206714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545503b-6d2a-497a-a67e-2e2a57787548 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:53.207179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545503b-6d2a-497a-a67e-2e2a57787548 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:53.207663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545503b-6d2a-497a-a67e-2e2a57787548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:53.209986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f545503b-6d2a-497a-a67e-2e2a57787548 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:53.316138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545503b-6d2a-497a-a67e-2e2a57787548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:53.317853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545503b-6d2a-497a-a67e-2e2a57787548 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:53.333314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 814/1647] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:53.436010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514a4d7-1cb7-4ea6-8adc-18cabc39770c service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:53.438241 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a514a4d7-1cb7-4ea6-8adc-18cabc39770c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:53.454583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514a4d7-1cb7-4ea6-8adc-18cabc39770c service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:53.470861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e67dd-3e11-4f0c-b10c-033b142a53c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:53.471535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e67dd-3e11-4f0c-b10c-033b142a53c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:53.472224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e67dd-3e11-4f0c-b10c-033b142a53c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:53.472224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e67dd-3e11-4f0c-b10c-033b142a53c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:53.476685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-652e67dd-3e11-4f0c-b10c-033b142a53c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:53.646925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e67dd-3e11-4f0c-b10c-033b142a53c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:53.648573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e67dd-3e11-4f0c-b10c-033b142a53c1 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:53.661983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 834/1648] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:54.137634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545503b-6d2a-497a-a67e-2e2a57787548 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:54.139283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f545503b-6d2a-497a-a67e-2e2a57787548 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:54.162753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545503b-6d2a-497a-a67e-2e2a57787548 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:54.177683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:54.178364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:54.178649 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:54.178931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] PATH_INFO: `/v3/projects/b5758d6346314cb3bac448b4b052e32c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:54.180732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5758d6346314cb3bac448b4b052e32c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:54.181828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:03:54.181828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jul 25 23:03:54.181828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: Jul 25 23:03:54.183303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:54.461862 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5758d6346314cb3bac448b4b052e32c', 'request_id': 'req-1704f31b-d1e8-4bef-8022-89433bd9ad3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:54.516301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5758d6346314cb3bac448b4b052e32c', 'request_id': 'req-1704f31b-d1e8-4bef-8022-89433bd9ad3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:54.628633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5758d6346314cb3bac448b4b052e32c', 'request_id': 'req-1704f31b-d1e8-4bef-8022-89433bd9ad3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:54.655704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] The token cache is being invalidate because project b5758d6346314cb3bac448b4b052e32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:03:54.656145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:54.658154 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1704f31b-d1e8-4bef-8022-89433bd9ad3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:54.671668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 815/1649] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:03:54 2022] DELETE /identity/v3/projects/b5758d6346314cb3bac448b4b052e32c => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:54.674582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98d634-7840-456d-95b4-26e6c3e3d3a5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:54.675051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98d634-7840-456d-95b4-26e6c3e3d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:54.675935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98d634-7840-456d-95b4-26e6c3e3d3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:54.734290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:54.753890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ae98d634-7840-456d-95b4-26e6c3e3d3a5 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:54.756685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ae98d634-7840-456d-95b4-26e6c3e3d3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:54.868973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 835/1650] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:54.878595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4900-2790-411f-a6f7-a7549873dbe2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:54.878957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4900-2790-411f-a6f7-a7549873dbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:54.879235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4900-2790-411f-a6f7-a7549873dbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:54.916954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d68f4900-2790-411f-a6f7-a7549873dbe2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:54.924025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d68f4900-2790-411f-a6f7-a7549873dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:54.941199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 816/1651] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:54.945664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98d634-7840-456d-95b4-26e6c3e3d3a5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:54.962061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98d634-7840-456d-95b4-26e6c3e3d3a5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:54.976773 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7125f-047a-4fb1-9bb9-fe692e800e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:54.977757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7125f-047a-4fb1-9bb9-fe692e800e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:54.978176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7125f-047a-4fb1-9bb9-fe692e800e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:54.979509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7125f-047a-4fb1-9bb9-fe692e800e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:54.981261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7125f-047a-4fb1-9bb9-fe692e800e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:54.985874 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7125f-047a-4fb1-9bb9-fe692e800e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:54.987790 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7125f-047a-4fb1-9bb9-fe692e800e5b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:55.017205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 836/1652] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:55.020451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f4900-2790-411f-a6f7-a7549873dbe2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:55.033482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f4900-2790-411f-a6f7-a7549873dbe2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:55.047864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8f550-1c91-4ce5-bb9e-c7cd9af278c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:55.048426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f550-1c91-4ce5-bb9e-c7cd9af278c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:55.048783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f550-1c91-4ce5-bb9e-c7cd9af278c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:55.049727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f550-1c91-4ce5-bb9e-c7cd9af278c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:55.049908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8f550-1c91-4ce5-bb9e-c7cd9af278c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:55.051959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8f550-1c91-4ce5-bb9e-c7cd9af278c1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:55.337166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 817/1653] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:55 2022] POST /identity/v3/projects => generated 365 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:03:55.346585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7125f-047a-4fb1-9bb9-fe692e800e5b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:55.367399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7125f-047a-4fb1-9bb9-fe692e800e5b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:55.615442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95f52-e5ac-4806-888f-509086150d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:55.616267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95f52-e5ac-4806-888f-509086150d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:55.617183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95f52-e5ac-4806-888f-509086150d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:55.617576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95f52-e5ac-4806-888f-509086150d01 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:55.619501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb95f52-e5ac-4806-888f-509086150d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:55.623218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb95f52-e5ac-4806-888f-509086150d01 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:55.755976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 837/1654] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:55 2022] POST /identity/v3/users => generated 283 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:55.762153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8f550-1c91-4ce5-bb9e-c7cd9af278c1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:55.782368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8f550-1c91-4ce5-bb9e-c7cd9af278c1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:55.795733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b395db5-4ec3-41b1-9b45-95c34120fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:55.796736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b395db5-4ec3-41b1-9b45-95c34120fd16 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:55.798633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b395db5-4ec3-41b1-9b45-95c34120fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:55.799082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b395db5-4ec3-41b1-9b45-95c34120fd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:55.801936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b395db5-4ec3-41b1-9b45-95c34120fd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:55.807483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b395db5-4ec3-41b1-9b45-95c34120fd16 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:55.835536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 818/1655] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:55.840295 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95f52-e5ac-4806-888f-509086150d01 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:55.856456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95f52-e5ac-4806-888f-509086150d01 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:55.866504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255a2fe-c8ec-4bf6-8486-5787363f611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:55.867988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255a2fe-c8ec-4bf6-8486-5787363f611c admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:55.867988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255a2fe-c8ec-4bf6-8486-5787363f611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:55.867988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255a2fe-c8ec-4bf6-8486-5787363f611c admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:55.870447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255a2fe-c8ec-4bf6-8486-5787363f611c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:55.873406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255a2fe-c8ec-4bf6-8486-5787363f611c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:55.895405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 838/1656] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:55.899519 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b395db5-4ec3-41b1-9b45-95c34120fd16 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:55.914134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b395db5-4ec3-41b1-9b45-95c34120fd16 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:55.951851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cb23a-f189-4081-95b7-3a57fd78dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:55.955962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb23a-f189-4081-95b7-3a57fd78dd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:55.957856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb23a-f189-4081-95b7-3a57fd78dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:55.958175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb23a-f189-4081-95b7-3a57fd78dd44 admin admin] PATH_INFO: `/v3/projects/1b2d869c9f194c68bb07031b96e56adc/users/de11f94e91ae429f9cb904ae23e1c07f/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:55.997912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb23a-f189-4081-95b7-3a57fd78dd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2d869c9f194c68bb07031b96e56adc, user_id=de11f94e91ae429f9cb904ae23e1c07f, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:56.001523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb23a-f189-4081-95b7-3a57fd78dd44 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:56.139159 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 819/1657] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:55 2022] PUT /identity/v3/projects/1b2d869c9f194c68bb07031b96e56adc/users/de11f94e91ae429f9cb904ae23e1c07f/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:56.150675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24d82-9bdb-4e60-85bf-2f78295d484b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:56.151258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24d82-9bdb-4e60-85bf-2f78295d484b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:56.152760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24d82-9bdb-4e60-85bf-2f78295d484b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:56.190512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3ca24d82-9bdb-4e60-85bf-2f78295d484b None None] MFA Rules not processed for user `de11f94e91ae429f9cb904ae23e1c07f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:56.194648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3ca24d82-9bdb-4e60-85bf-2f78295d484b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:56.465960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 839/1658] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:56.466959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cb23a-f189-4081-95b7-3a57fd78dd44 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:56.486874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:56.639826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cb23a-f189-4081-95b7-3a57fd78dd44 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:56.656853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b391e-243f-4e9b-8494-ea68d9dfed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:56.659625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b391e-243f-4e9b-8494-ea68d9dfed50 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:56.659919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b391e-243f-4e9b-8494-ea68d9dfed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:56.673344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b391e-243f-4e9b-8494-ea68d9dfed50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:56.673344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b391e-243f-4e9b-8494-ea68d9dfed50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:56.673344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b391e-243f-4e9b-8494-ea68d9dfed50 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:56.796637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca24d82-9bdb-4e60-85bf-2f78295d484b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:56.798340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3ca24d82-9bdb-4e60-85bf-2f78295d484b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:56.817476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:56.835206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 820/1659] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:56 2022] POST /identity/v3/projects => generated 365 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:03:56.839495 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b391e-243f-4e9b-8494-ea68d9dfed50 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:56.841082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca24d82-9bdb-4e60-85bf-2f78295d484b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:57.107959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b391e-243f-4e9b-8494-ea68d9dfed50 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:57.113033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c48f80-9479-49ef-bc24-8c371ed2cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:57.113741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48f80-9479-49ef-bc24-8c371ed2cca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:57.114029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48f80-9479-49ef-bc24-8c371ed2cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:57.114313 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48f80-9479-49ef-bc24-8c371ed2cca3 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:57.115015 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c48f80-9479-49ef-bc24-8c371ed2cca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:57.122499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:57.123763 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:57.123763 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:57.124333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] PATH_INFO: `/v3/users/a06b78b123714677897220d34d46b5e7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:57.126895 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06b78b123714677897220d34d46b5e7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:57.127930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:03:57.127930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jul 25 23:03:57.127930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: Jul 25 23:03:57.129180 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:57.133256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c48f80-9479-49ef-bc24-8c371ed2cca3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:57.319067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 821/1660] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:56 2022] POST /identity/v3/users => generated 289 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:03:57.322831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c48f80-9479-49ef-bc24-8c371ed2cca3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:57.341890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c48f80-9479-49ef-bc24-8c371ed2cca3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:57.354699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b2666-e2fb-4e6e-bf22-7e5f30647cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:57.356192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b2666-e2fb-4e6e-bf22-7e5f30647cef admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:57.356735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b2666-e2fb-4e6e-bf22-7e5f30647cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:57.357343 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b2666-e2fb-4e6e-bf22-7e5f30647cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:57.358175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b2666-e2fb-4e6e-bf22-7e5f30647cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:57.360159 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b2666-e2fb-4e6e-bf22-7e5f30647cef admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:57.373179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 822/1661] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:03:57.378198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b2666-e2fb-4e6e-bf22-7e5f30647cef admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:57.398343 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b2666-e2fb-4e6e-bf22-7e5f30647cef admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:57.406685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855161e-0ccf-4ee3-8d39-dfb30a9284c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:57.407632 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855161e-0ccf-4ee3-8d39-dfb30a9284c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:57.408079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855161e-0ccf-4ee3-8d39-dfb30a9284c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:57.408516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855161e-0ccf-4ee3-8d39-dfb30a9284c5 admin admin] PATH_INFO: `/v3/projects/c9c5f67bd7fb418bbc2915c301eb88d0/users/bcae6cded45d407f94db4e2deb2a1455/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:57.455682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855161e-0ccf-4ee3-8d39-dfb30a9284c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c5f67bd7fb418bbc2915c301eb88d0, user_id=bcae6cded45d407f94db4e2deb2a1455, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:57.461403 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855161e-0ccf-4ee3-8d39-dfb30a9284c5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:57.463336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06b78b123714677897220d34d46b5e7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:57.480793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06b78b123714677897220d34d46b5e7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:57.562682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 823/1662] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:57 2022] PUT /identity/v3/projects/c9c5f67bd7fb418bbc2915c301eb88d0/users/bcae6cded45d407f94db4e2deb2a1455/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:03:57.568271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855161e-0ccf-4ee3-8d39-dfb30a9284c5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:57.617301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06b78b123714677897220d34d46b5e7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:57.618035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06b78b123714677897220d34d46b5e7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:57.618558 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5e972b0c-4ac8-4580-af85-4f443e0708f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06b78b123714677897220d34d46b5e7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:57.683553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 840/1663] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:03:56 2022] DELETE /identity/v3/users/a06b78b123714677897220d34d46b5e7 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:03:57.689150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca6d39-3eef-494c-9855-dd607dfe4942 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:57.690075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca6d39-3eef-494c-9855-dd607dfe4942 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:57.690075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca6d39-3eef-494c-9855-dd607dfe4942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:57.728282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6eca6d39-3eef-494c-9855-dd607dfe4942 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:57.734606 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6eca6d39-3eef-494c-9855-dd607dfe4942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:57.771492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855161e-0ccf-4ee3-8d39-dfb30a9284c5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:57.887201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 841/1664] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:57.969037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fc2d8-7653-4e83-bced-cbf5197e2a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:57.974406 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc2d8-7653-4e83-bced-cbf5197e2a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:57.974754 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc2d8-7653-4e83-bced-cbf5197e2a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:57.975042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc2d8-7653-4e83-bced-cbf5197e2a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:57.975783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fc2d8-7653-4e83-bced-cbf5197e2a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:57.982063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca6d39-3eef-494c-9855-dd607dfe4942 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:57.983592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6eca6d39-3eef-494c-9855-dd607dfe4942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:57.987051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fc2d8-7653-4e83-bced-cbf5197e2a03 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:58.006534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 824/1665] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:58.010361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fc2d8-7653-4e83-bced-cbf5197e2a03 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:58.020473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2e0fc2d8-7653-4e83-bced-cbf5197e2a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:58.047520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fc2d8-7653-4e83-bced-cbf5197e2a03 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:58.057461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f6870-751e-49c9-8242-5a8706fa2ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:58.059061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f6870-751e-49c9-8242-5a8706fa2ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:58.059407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f6870-751e-49c9-8242-5a8706fa2ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:58.059695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f6870-751e-49c9-8242-5a8706fa2ccf admin admin] PATH_INFO: `/v3/projects/c9c5f67bd7fb418bbc2915c301eb88d0/users/bcae6cded45d407f94db4e2deb2a1455/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:58.065896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f6870-751e-49c9-8242-5a8706fa2ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c5f67bd7fb418bbc2915c301eb88d0, user_id=bcae6cded45d407f94db4e2deb2a1455, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:58.079037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f6870-751e-49c9-8242-5a8706fa2ccf admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:58.129186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 825/1666] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:58 2022] PUT /identity/v3/projects/c9c5f67bd7fb418bbc2915c301eb88d0/users/bcae6cded45d407f94db4e2deb2a1455/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:58.139292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0aa71-8d7b-4dce-8749-571386fff024 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:58.139587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0aa71-8d7b-4dce-8749-571386fff024 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:58.139864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0aa71-8d7b-4dce-8749-571386fff024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:58.187449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca6d39-3eef-494c-9855-dd607dfe4942 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:58.238921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-95b0aa71-8d7b-4dce-8749-571386fff024 None None] MFA Rules not processed for user `bcae6cded45d407f94db4e2deb2a1455`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:58.241167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-95b0aa71-8d7b-4dce-8749-571386fff024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:58.344063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063199-dc64-4f53-b58d-be13876269c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:58.344849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063199-dc64-4f53-b58d-be13876269c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:58.345159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063199-dc64-4f53-b58d-be13876269c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:58.350037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063199-dc64-4f53-b58d-be13876269c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:58.412262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 826/1667] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:03:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:58.430344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0aa71-8d7b-4dce-8749-571386fff024 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:58.430344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-95b0aa71-8d7b-4dce-8749-571386fff024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:58.555776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0aa71-8d7b-4dce-8749-571386fff024 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:58.565327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063199-dc64-4f53-b58d-be13876269c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:58.566838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45362b7-735c-43aa-b652-2663bcad3bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:58.568588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45362b7-735c-43aa-b652-2663bcad3bca service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:58.568847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45362b7-735c-43aa-b652-2663bcad3bca service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:58.569203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45362b7-735c-43aa-b652-2663bcad3bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:58.584015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063199-dc64-4f53-b58d-be13876269c6 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:58.587405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45362b7-735c-43aa-b652-2663bcad3bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:58.590243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45362b7-735c-43aa-b652-2663bcad3bca service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:58.610261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 842/1668] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:58.622711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 827/1669] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:03:58.870061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:58.890463 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063199-dc64-4f53-b58d-be13876269c6 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:58.912160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063199-dc64-4f53-b58d-be13876269c6 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:58.918649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756981ba-4e69-455f-bc46-76aab4269873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:58.920531 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756981ba-4e69-455f-bc46-76aab4269873 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:58.921019 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756981ba-4e69-455f-bc46-76aab4269873 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:58.921786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756981ba-4e69-455f-bc46-76aab4269873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:58.924045 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-756981ba-4e69-455f-bc46-76aab4269873 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:59.063622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756981ba-4e69-455f-bc46-76aab4269873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:59.066812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756981ba-4e69-455f-bc46-76aab4269873 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:59.115293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 843/1670] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:59.349034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:00.000915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45362b7-735c-43aa-b652-2663bcad3bca service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:00.010119 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a45362b7-735c-43aa-b652-2663bcad3bca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:00.060577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45362b7-735c-43aa-b652-2663bcad3bca service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:00.066616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:00.067625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:00.068059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:00.068653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] PATH_INFO: `/v3/projects/5d3254035db24cdd8100a97407aad11b` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:00.070224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3254035db24cdd8100a97407aad11b)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:00.072183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:00.313068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3254035db24cdd8100a97407aad11b', 'request_id': 'req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:00.332735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3254035db24cdd8100a97407aad11b', 'request_id': 'req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:00.437079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3254035db24cdd8100a97407aad11b', 'request_id': 'req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:00.461578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] The token cache is being invalidate because project 5d3254035db24cdd8100a97407aad11b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:00.461988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:00.463759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8cb4f02b-713f-4b6c-b4f6-9fc3fff47450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:00.471377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 828/1671] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:03:59 2022] DELETE /identity/v3/projects/5d3254035db24cdd8100a97407aad11b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:00.476581 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c1ae7-6078-4ea6-ac38-3ef844548279 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:00.477094 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c1ae7-6078-4ea6-ac38-3ef844548279 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:00.477918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c1ae7-6078-4ea6-ac38-3ef844548279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:00.518188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1f7c1ae7-6078-4ea6-ac38-3ef844548279 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:00.521708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1f7c1ae7-6078-4ea6-ac38-3ef844548279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:00.572105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:00.648090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 844/1672] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:00.657484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6e6b9-5443-44b6-b515-4e0979b019b3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:00.658117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6e6b9-5443-44b6-b515-4e0979b019b3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:00.658588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6e6b9-5443-44b6-b515-4e0979b019b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:00.697361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-eba6e6b9-5443-44b6-b515-4e0979b019b3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:00.699468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-eba6e6b9-5443-44b6-b515-4e0979b019b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:00.726269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c1ae7-6078-4ea6-ac38-3ef844548279 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:00.729004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 829/1673] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:00.739868 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c1ae7-6078-4ea6-ac38-3ef844548279 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:00.749990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9681e0b-d867-4687-84e1-c8bcca192bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:00.751090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9681e0b-d867-4687-84e1-c8bcca192bab admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:00.751560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9681e0b-d867-4687-84e1-c8bcca192bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:00.752010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9681e0b-d867-4687-84e1-c8bcca192bab admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:00.752993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9681e0b-d867-4687-84e1-c8bcca192bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:00.753500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9681e0b-d867-4687-84e1-c8bcca192bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:00.756419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9681e0b-d867-4687-84e1-c8bcca192bab admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:00.781893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6e6b9-5443-44b6-b515-4e0979b019b3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:00.787527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 845/1674] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:00.792110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6e6b9-5443-44b6-b515-4e0979b019b3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:00.799429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb3779-3e91-420a-a324-0c24f84c798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:00.800299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb3779-3e91-420a-a324-0c24f84c798f admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:00.800740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb3779-3e91-420a-a324-0c24f84c798f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:00.801297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb3779-3e91-420a-a324-0c24f84c798f admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:00.806611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb3779-3e91-420a-a324-0c24f84c798f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:00.806611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb3779-3e91-420a-a324-0c24f84c798f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:00.904529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:00.925031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 830/1675] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:00 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:00.929389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9681e0b-d867-4687-84e1-c8bcca192bab admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:00.952509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9681e0b-d867-4687-84e1-c8bcca192bab admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:01.096759 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d138e-e512-40fa-8902-94fb934b79dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:01.098236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d138e-e512-40fa-8902-94fb934b79dc admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:01.098672 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d138e-e512-40fa-8902-94fb934b79dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:01.099168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d138e-e512-40fa-8902-94fb934b79dc admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:01.100255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d138e-e512-40fa-8902-94fb934b79dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:01.102881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d138e-e512-40fa-8902-94fb934b79dc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:01.204642 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 846/1676] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:00 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:01.204921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb3779-3e91-420a-a324-0c24f84c798f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:01.216579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb3779-3e91-420a-a324-0c24f84c798f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:01.223121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b550-9f87-4552-80fd-0548d5048a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:01.224192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b550-9f87-4552-80fd-0548d5048a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:01.224969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b550-9f87-4552-80fd-0548d5048a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:01.225509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b550-9f87-4552-80fd-0548d5048a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:01.226619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b550-9f87-4552-80fd-0548d5048a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:01.234300 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b550-9f87-4552-80fd-0548d5048a5d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:01.267537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d138e-e512-40fa-8902-94fb934b79dc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:01.268686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 831/1677] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:01.282452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d138e-e512-40fa-8902-94fb934b79dc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:01.289793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f7423-2f98-458a-a883-146c208fdda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:01.295056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f7423-2f98-458a-a883-146c208fdda8 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:01.295056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f7423-2f98-458a-a883-146c208fdda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:01.295056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f7423-2f98-458a-a883-146c208fdda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:01.295056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f7423-2f98-458a-a883-146c208fdda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:01.295376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f7423-2f98-458a-a883-146c208fdda8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:01.313203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 847/1678] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:01.314524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b550-9f87-4552-80fd-0548d5048a5d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:01.329959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b550-9f87-4552-80fd-0548d5048a5d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:01.337954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea40826-963c-42d0-81d9-262f2819d4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:01.340075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea40826-963c-42d0-81d9-262f2819d4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:01.340374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea40826-963c-42d0-81d9-262f2819d4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:01.340686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea40826-963c-42d0-81d9-262f2819d4ce admin admin] PATH_INFO: `/v3/projects/f6bbe855c5fb42e8bbbf913d06dcbecc/users/2377949db6984bb5a71066c947a27192/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:01.366321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea40826-963c-42d0-81d9-262f2819d4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bbe855c5fb42e8bbbf913d06dcbecc, user_id=2377949db6984bb5a71066c947a27192, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:01.372021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea40826-963c-42d0-81d9-262f2819d4ce admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:01.478462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150f90-81dd-43d6-8771-eed65106b9cf None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:01.481624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150f90-81dd-43d6-8771-eed65106b9cf None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:01.482030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150f90-81dd-43d6-8771-eed65106b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:01.516064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 832/1679] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:01 2022] PUT /identity/v3/projects/f6bbe855c5fb42e8bbbf913d06dcbecc/users/2377949db6984bb5a71066c947a27192/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:01.527880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a68939-6231-46a5-b479-0f477c3fea6f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:01.528409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a68939-6231-46a5-b479-0f477c3fea6f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:01.528841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a68939-6231-46a5-b479-0f477c3fea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:01.566979 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-46150f90-81dd-43d6-8771-eed65106b9cf None None] MFA Rules not processed for user `61d3b5a3082a4c74a2a08007581388c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:01.570482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-46150f90-81dd-43d6-8771-eed65106b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:01.618041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-79a68939-6231-46a5-b479-0f477c3fea6f None None] MFA Rules not processed for user `2377949db6984bb5a71066c947a27192`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:01.623229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-79a68939-6231-46a5-b479-0f477c3fea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:01.765896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 848/1680] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:01.768060 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382ad56-5b84-4c12-b75d-c3b39073829c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:01.768689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382ad56-5b84-4c12-b75d-c3b39073829c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:01.769072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382ad56-5b84-4c12-b75d-c3b39073829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:01.823256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 833/1681] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:01.826647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859e029-8d75-4026-a74d-e0039f7009a3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:01.827135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859e029-8d75-4026-a74d-e0039f7009a3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:01.827580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859e029-8d75-4026-a74d-e0039f7009a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:01.841685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d382ad56-5b84-4c12-b75d-c3b39073829c None None] MFA Rules not processed for user `61d3b5a3082a4c74a2a08007581388c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:01.842917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d382ad56-5b84-4c12-b75d-c3b39073829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:01.858298 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 849/1682] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:01.859271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382ad56-5b84-4c12-b75d-c3b39073829c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:01.860650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d382ad56-5b84-4c12-b75d-c3b39073829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:01.879061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a859e029-8d75-4026-a74d-e0039f7009a3 None None] MFA Rules not processed for user `20625ee0dcb0427183ad6f9865ff5764`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:01.880770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a859e029-8d75-4026-a74d-e0039f7009a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:01.888371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:01.893092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:01.964514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382ad56-5b84-4c12-b75d-c3b39073829c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:01.969181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7b468-ff91-4e9e-9b0d-8fb8bcc4791d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:01.970053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7b468-ff91-4e9e-9b0d-8fb8bcc4791d service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:01.970610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7b468-ff91-4e9e-9b0d-8fb8bcc4791d service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:01.971039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7b468-ff91-4e9e-9b0d-8fb8bcc4791d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:01.982953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7b468-ff91-4e9e-9b0d-8fb8bcc4791d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:01.986872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7b468-ff91-4e9e-9b0d-8fb8bcc4791d service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:02.007278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 850/1683] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:02.008531 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7b468-ff91-4e9e-9b0d-8fb8bcc4791d service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:02.013020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-efe7b468-ff91-4e9e-9b0d-8fb8bcc4791d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:02.064007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 834/1684] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:02.082203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c671504-8f12-4ebd-a569-74b2cd9848db None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:02.082203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c671504-8f12-4ebd-a569-74b2cd9848db None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:02.082203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c671504-8f12-4ebd-a569-74b2cd9848db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:02.118046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3c671504-8f12-4ebd-a569-74b2cd9848db None None] MFA Rules not processed for user `20625ee0dcb0427183ad6f9865ff5764`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:02.118046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3c671504-8f12-4ebd-a569-74b2cd9848db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:02.128479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 835/1685] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:02.148478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c671504-8f12-4ebd-a569-74b2cd9848db None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:02.154065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3c671504-8f12-4ebd-a569-74b2cd9848db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:02.216980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7b468-ff91-4e9e-9b0d-8fb8bcc4791d service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:02.252058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7ecde-ea45-44e8-b19e-deaa5e0e23b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:02.254017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7ecde-ea45-44e8-b19e-deaa5e0e23b4 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:02.254017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7ecde-ea45-44e8-b19e-deaa5e0e23b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:02.254224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7ecde-ea45-44e8-b19e-deaa5e0e23b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:02.273084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7ecde-ea45-44e8-b19e-deaa5e0e23b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:02.274717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7ecde-ea45-44e8-b19e-deaa5e0e23b4 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:02.296103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 851/1686] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:02.334868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c671504-8f12-4ebd-a569-74b2cd9848db None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:02.343498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fda83-30c5-4646-b477-aab5816d4fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:02.344312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fda83-30c5-4646-b477-aab5816d4fbd service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:02.345928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fda83-30c5-4646-b477-aab5816d4fbd service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:02.346480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fda83-30c5-4646-b477-aab5816d4fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:02.358950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fda83-30c5-4646-b477-aab5816d4fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:02.361795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fda83-30c5-4646-b477-aab5816d4fbd service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:02.391219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 836/1687] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:03.007230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f94c-a57f-4eed-b472-2ac3a5107103 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:03.008332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f94c-a57f-4eed-b472-2ac3a5107103 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:03.008768 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f94c-a57f-4eed-b472-2ac3a5107103 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:03.010892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 852/1688] 10.222.0.55 () {54 vars in 912 bytes} [Mon Jul 25 23:04:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:04:03.018166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32153a00-c215-43bf-b03b-0387ec4a3e0f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:03.018560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32153a00-c215-43bf-b03b-0387ec4a3e0f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:03.019223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32153a00-c215-43bf-b03b-0387ec4a3e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:03.094711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae59bb-fd8b-499b-b3c7-e85641b27e63 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:03.095009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae59bb-fd8b-499b-b3c7-e85641b27e63 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:03.095260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae59bb-fd8b-499b-b3c7-e85641b27e63 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:03.096854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 853/1689] 10.222.0.55 () {54 vars in 912 bytes} [Mon Jul 25 23:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:04:03.109737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9d97-9700-4f35-bd80-43599e45989e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:03.110041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9d97-9700-4f35-bd80-43599e45989e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:03.110289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9d97-9700-4f35-bd80-43599e45989e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:03.170297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-32153a00-c215-43bf-b03b-0387ec4a3e0f None None] MFA Rules not processed for user `aa8cd52bd9f24f7d8ed93943aaaeaa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:03.170297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-32153a00-c215-43bf-b03b-0387ec4a3e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:03.172167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-800c9d97-9700-4f35-bd80-43599e45989e None None] MFA Rules not processed for user `aa8cd52bd9f24f7d8ed93943aaaeaa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:03.178964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-800c9d97-9700-4f35-bd80-43599e45989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:03.343559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 854/1690] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:04:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:03.355484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c9d97-9700-4f35-bd80-43599e45989e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:03.356931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-800c9d97-9700-4f35-bd80-43599e45989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:03.382169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c9d97-9700-4f35-bd80-43599e45989e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:03.394947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35df0bd-8528-4f1b-b0ad-2bd106677704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:03.395792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df0bd-8528-4f1b-b0ad-2bd106677704 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:03.396216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df0bd-8528-4f1b-b0ad-2bd106677704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:03.397618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df0bd-8528-4f1b-b0ad-2bd106677704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:03.436701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 837/1691] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:04:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:03.438937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35df0bd-8528-4f1b-b0ad-2bd106677704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:03.446130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32153a00-c215-43bf-b03b-0387ec4a3e0f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:03.446559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35df0bd-8528-4f1b-b0ad-2bd106677704 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:03.479029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 855/1692] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:04:03.497683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32153a00-c215-43bf-b03b-0387ec4a3e0f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:03.520406 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066158b-ec19-4748-9ce9-db2189215e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:03.520406 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066158b-ec19-4748-9ce9-db2189215e1d service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:03.520406 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066158b-ec19-4748-9ce9-db2189215e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:03.520406 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066158b-ec19-4748-9ce9-db2189215e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:03.563925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066158b-ec19-4748-9ce9-db2189215e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:03.573226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066158b-ec19-4748-9ce9-db2189215e1d service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:03.601268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 838/1693] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:04:04.998650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab60353-26ba-4c20-a1ba-6f50dbc8f207 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:05.000106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab60353-26ba-4c20-a1ba-6f50dbc8f207 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:05.000658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab60353-26ba-4c20-a1ba-6f50dbc8f207 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:05.002890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 856/1694] 10.222.0.55 () {54 vars in 961 bytes} [Mon Jul 25 23:04:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:04:05.009746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6458-292e-42a6-ad59-ff2601a172f3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:05.011005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6458-292e-42a6-ad59-ff2601a172f3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:05.011446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6458-292e-42a6-ad59-ff2601a172f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:05.054521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:05.077985 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-60aa6458-292e-42a6-ad59-ff2601a172f3 None None] MFA Rules not processed for user `0aa69689b82d4994beac3b698d40c37f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:05.079339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-60aa6458-292e-42a6-ad59-ff2601a172f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:05.313250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 839/1695] 10.222.0.55 () {58 vars in 1058 bytes} [Mon Jul 25 23:04:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:05.322482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab60353-26ba-4c20-a1ba-6f50dbc8f207 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:05.361987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab60353-26ba-4c20-a1ba-6f50dbc8f207 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:05.384811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc5f77-754a-4644-8e45-b05be3463e1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:05.385479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5f77-754a-4644-8e45-b05be3463e1f service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:05.385790 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5f77-754a-4644-8e45-b05be3463e1f service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:05.386633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5f77-754a-4644-8e45-b05be3463e1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:05.397300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fdcc5f77-754a-4644-8e45-b05be3463e1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:05.451993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc5f77-754a-4644-8e45-b05be3463e1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:05.454771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc5f77-754a-4644-8e45-b05be3463e1f service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:05.477198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 857/1696] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:05.501377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d4b71-147c-43ad-84f1-92c24c99c121 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:05.502710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d4b71-147c-43ad-84f1-92c24c99c121 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:05.502888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d4b71-147c-43ad-84f1-92c24c99c121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:05.554895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1c7d4b71-147c-43ad-84f1-92c24c99c121 None None] MFA Rules not processed for user `61d3b5a3082a4c74a2a08007581388c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:05.556153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1c7d4b71-147c-43ad-84f1-92c24c99c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:05.608347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 840/1697] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:06.897553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc5f77-754a-4644-8e45-b05be3463e1f service placement] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:06.899966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fdcc5f77-754a-4644-8e45-b05be3463e1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:06.946956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:07.110607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc5f77-754a-4644-8e45-b05be3463e1f service placement] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:07.161032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:07.162164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:07.162586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:07.163401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] PATH_INFO: `/v3/users/de11f94e91ae429f9cb904ae23e1c07f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:07.168341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de11f94e91ae429f9cb904ae23e1c07f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:07.174320 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:07.613369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de11f94e91ae429f9cb904ae23e1c07f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:07.649817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de11f94e91ae429f9cb904ae23e1c07f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:07.771110 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de11f94e91ae429f9cb904ae23e1c07f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:07.771929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de11f94e91ae429f9cb904ae23e1c07f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:07.772707 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de11f94e91ae429f9cb904ae23e1c07f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:07.853852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 858/1698] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:06 2022] DELETE /identity/v3/users/de11f94e91ae429f9cb904ae23e1c07f => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:07.859363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3150-d862-4fd5-aa86-410575631f16 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:07.859872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3150-d862-4fd5-aa86-410575631f16 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:07.862813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3150-d862-4fd5-aa86-410575631f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:07.915004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-71ef3150-d862-4fd5-aa86-410575631f16 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:07.916257 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-71ef3150-d862-4fd5-aa86-410575631f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:08.190987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 841/1699] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:08.218822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:08.221329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:08.433621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9649fc-f475-445e-846e-797b5f414632 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:08.444155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f768f-d82b-422e-bc8d-180ec0c2178b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:08.444820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f768f-d82b-422e-bc8d-180ec0c2178b service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:08.445112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f768f-d82b-422e-bc8d-180ec0c2178b service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:08.450289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f768f-d82b-422e-bc8d-180ec0c2178b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:08.486553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f768f-d82b-422e-bc8d-180ec0c2178b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:08.486553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f768f-d82b-422e-bc8d-180ec0c2178b service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:08.523069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e154d-3ce7-4807-be26-98de84e57f18 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:08.523429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e154d-3ce7-4807-be26-98de84e57f18 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:08.523779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e154d-3ce7-4807-be26-98de84e57f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:08.527396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 859/1700] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:04:08.641200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8b6e154d-3ce7-4807-be26-98de84e57f18 None None] MFA Rules not processed for user `4eea5a29c87d431299b220e404fd5732`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:08.650079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8b6e154d-3ce7-4807-be26-98de84e57f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:08.820845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4264d-649d-4153-ba87-c8f2c7bc9172 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:08.821153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4264d-649d-4153-ba87-c8f2c7bc9172 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:08.821452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4264d-649d-4153-ba87-c8f2c7bc9172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:08.885473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-acd4264d-649d-4153-ba87-c8f2c7bc9172 None None] MFA Rules not processed for user `fbc4fc1f207c4726b9c05b6b338f0e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:08.887397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-acd4264d-649d-4153-ba87-c8f2c7bc9172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:08.903335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 842/1701] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:08.924855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e154d-3ce7-4807-be26-98de84e57f18 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:08.943902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8b6e154d-3ce7-4807-be26-98de84e57f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:08.974114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:09.038892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:09.057337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 860/1702] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:09.072544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4264d-649d-4153-ba87-c8f2c7bc9172 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:09.081257 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-acd4264d-649d-4153-ba87-c8f2c7bc9172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:09.120565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e154d-3ce7-4807-be26-98de84e57f18 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:09.144597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28d95b-7df5-4347-aa9d-4f8ee98a0e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:09.144597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28d95b-7df5-4347-aa9d-4f8ee98a0e3d service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:09.144597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28d95b-7df5-4347-aa9d-4f8ee98a0e3d service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:09.144597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28d95b-7df5-4347-aa9d-4f8ee98a0e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:09.164394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28d95b-7df5-4347-aa9d-4f8ee98a0e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:09.167616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28d95b-7df5-4347-aa9d-4f8ee98a0e3d service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:09.204582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 843/1703] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:09.295053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4264d-649d-4153-ba87-c8f2c7bc9172 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:09.308530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78770877-a66a-47b5-abbb-7533bf150a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:09.310335 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78770877-a66a-47b5-abbb-7533bf150a0c service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:09.310788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78770877-a66a-47b5-abbb-7533bf150a0c service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:09.311831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78770877-a66a-47b5-abbb-7533bf150a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:09.345909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78770877-a66a-47b5-abbb-7533bf150a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:09.349189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78770877-a66a-47b5-abbb-7533bf150a0c service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:09.363956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 861/1704] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:09.695303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28d95b-7df5-4347-aa9d-4f8ee98a0e3d service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:09.697467 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6f28d95b-7df5-4347-aa9d-4f8ee98a0e3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:09.759900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28d95b-7df5-4347-aa9d-4f8ee98a0e3d service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:09.772634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:09.774035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:09.774661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:09.777420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] PATH_INFO: `/v3/projects/1b2d869c9f194c68bb07031b96e56adc` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:09.779629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2d869c9f194c68bb07031b96e56adc)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:09.784769 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:09.963548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2d869c9f194c68bb07031b96e56adc', 'request_id': 'req-b9226502-8182-4b3d-b5b4-91e0cfe27885'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:09.974564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2d869c9f194c68bb07031b96e56adc', 'request_id': 'req-b9226502-8182-4b3d-b5b4-91e0cfe27885'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:10.127193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2d869c9f194c68bb07031b96e56adc', 'request_id': 'req-b9226502-8182-4b3d-b5b4-91e0cfe27885'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:10.170000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] The token cache is being invalidate because project 1b2d869c9f194c68bb07031b96e56adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:10.171567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:10.178654 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b9226502-8182-4b3d-b5b4-91e0cfe27885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:10.185645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 844/1705] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:09 2022] DELETE /identity/v3/projects/1b2d869c9f194c68bb07031b96e56adc => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:10.186970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78770877-a66a-47b5-abbb-7533bf150a0c service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:10.218008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78770877-a66a-47b5-abbb-7533bf150a0c service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:10.322942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:10.326563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:10.326741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:10.327029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] PATH_INFO: `/v3/users/bcae6cded45d407f94db4e2deb2a1455` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:10.331057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcae6cded45d407f94db4e2deb2a1455)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:10.333443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:10.748594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcae6cded45d407f94db4e2deb2a1455'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:10.791736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcae6cded45d407f94db4e2deb2a1455'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:10.897809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:10.902279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcae6cded45d407f94db4e2deb2a1455'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:10.904181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcae6cded45d407f94db4e2deb2a1455'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:10.907921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcae6cded45d407f94db4e2deb2a1455'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:10.971556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 862/1706] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:10 2022] DELETE /identity/v3/users/bcae6cded45d407f94db4e2deb2a1455 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:12.413681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2a5e8-3898-42b7-9a4e-ee11f25af0a7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:12.414127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2a5e8-3898-42b7-9a4e-ee11f25af0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:12.414233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2a5e8-3898-42b7-9a4e-ee11f25af0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:12.653805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8cc2a5e8-3898-42b7-9a4e-ee11f25af0a7 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:12.658858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8cc2a5e8-3898-42b7-9a4e-ee11f25af0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:12.858239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 845/1707] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:04:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:12.918450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:12.924529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:13.051231 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100582f-50fd-402e-a6a0-17cd8e96692c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:13.061929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:13.063091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:13.063677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:13.064074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] PATH_INFO: `/v3/users/589af27027794611b803a8577f9e4649` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:13.065897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=589af27027794611b803a8577f9e4649)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:13.069384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:13.266769 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2a5e8-3898-42b7-9a4e-ee11f25af0a7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:13.269613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8cc2a5e8-3898-42b7-9a4e-ee11f25af0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:13.305590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2a5e8-3898-42b7-9a4e-ee11f25af0a7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:13.333533 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:13.334203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:13.336953 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:13.338281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] PATH_INFO: `/v3/projects/c9c5f67bd7fb418bbc2915c301eb88d0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:13.346055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c5f67bd7fb418bbc2915c301eb88d0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:13.348214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589af27027794611b803a8577f9e4649'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:13.355014 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:13.357358 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:13.377972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589af27027794611b803a8577f9e4649'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:13.438842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589af27027794611b803a8577f9e4649'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:13.446803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589af27027794611b803a8577f9e4649'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:13.446803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589af27027794611b803a8577f9e4649'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:13.493582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 863/1708] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:12 2022] DELETE /identity/v3/users/589af27027794611b803a8577f9e4649 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:13.494598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:13.510675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:13.546946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c5f67bd7fb418bbc2915c301eb88d0', 'request_id': 'req-db849009-9a7a-4799-861c-145400c3971b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:13.557939 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c5f67bd7fb418bbc2915c301eb88d0', 'request_id': 'req-db849009-9a7a-4799-861c-145400c3971b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:13.655093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:13.696105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c5f67bd7fb418bbc2915c301eb88d0', 'request_id': 'req-db849009-9a7a-4799-861c-145400c3971b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:13.711951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] The token cache is being invalidate because project c9c5f67bd7fb418bbc2915c301eb88d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:13.712255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:13.717965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db849009-9a7a-4799-861c-145400c3971b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:13.728374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a2b6-3a54-4010-bea0-eed2e2594ccc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:13.739117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 846/1709] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:13 2022] DELETE /identity/v3/projects/c9c5f67bd7fb418bbc2915c301eb88d0 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:13.739432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac591e-edf1-43ab-8f1a-8ca793b10c7a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:13.739589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac591e-edf1-43ab-8f1a-8ca793b10c7a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:13.740024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac591e-edf1-43ab-8f1a-8ca793b10c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:13.781699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7dac591e-edf1-43ab-8f1a-8ca793b10c7a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:13.782961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7dac591e-edf1-43ab-8f1a-8ca793b10c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:13.914095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432629f-acd4-490d-8993-52adcc2abac0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:13.914918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432629f-acd4-490d-8993-52adcc2abac0 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:13.915297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432629f-acd4-490d-8993-52adcc2abac0 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:13.915844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432629f-acd4-490d-8993-52adcc2abac0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:13.921251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5432629f-acd4-490d-8993-52adcc2abac0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:13.953329 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 847/1710] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:13.954917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6bcc-7ac7-4ce7-8579-638973e6314c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:13.955351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6bcc-7ac7-4ce7-8579-638973e6314c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:13.957141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6bcc-7ac7-4ce7-8579-638973e6314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:13.985792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-473e6bcc-7ac7-4ce7-8579-638973e6314c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:13.988922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-473e6bcc-7ac7-4ce7-8579-638973e6314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:14.010956 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 848/1711] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:14.011841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e6bcc-7ac7-4ce7-8579-638973e6314c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:14.016303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-473e6bcc-7ac7-4ce7-8579-638973e6314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:14.124951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432629f-acd4-490d-8993-52adcc2abac0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:14.126640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432629f-acd4-490d-8993-52adcc2abac0 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:14.136789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 864/1712] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:04:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:04:14.137040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e6bcc-7ac7-4ce7-8579-638973e6314c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:14.137884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befa43b-2afd-41ab-973b-570985141af6 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:14.138169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befa43b-2afd-41ab-973b-570985141af6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:14.138545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befa43b-2afd-41ab-973b-570985141af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:14.144274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a794-4d57-49fd-ad97-6ae737748af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:14.145036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a794-4d57-49fd-ad97-6ae737748af9 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:14.145454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a794-4d57-49fd-ad97-6ae737748af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:14.146009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a794-4d57-49fd-ad97-6ae737748af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:14.166221 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a794-4d57-49fd-ad97-6ae737748af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:14.168250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a794-4d57-49fd-ad97-6ae737748af9 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:14.175137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2befa43b-2afd-41ab-973b-570985141af6 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:14.177547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2befa43b-2afd-41ab-973b-570985141af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:14.181763 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 849/1713] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:14.206177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 865/1714] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:14.210195 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a794-4d57-49fd-ad97-6ae737748af9 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:14.229809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a794-4d57-49fd-ad97-6ae737748af9 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:14.236675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2468-e82a-4882-8212-dd0ab871ed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:14.251071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2468-e82a-4882-8212-dd0ab871ed83 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:14.251793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2468-e82a-4882-8212-dd0ab871ed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:14.252179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2468-e82a-4882-8212-dd0ab871ed83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:14.253305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2468-e82a-4882-8212-dd0ab871ed83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:14.253711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2468-e82a-4882-8212-dd0ab871ed83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:14.258166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2468-e82a-4882-8212-dd0ab871ed83 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:14.301626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 850/1715] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:14.310477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befa43b-2afd-41ab-973b-570985141af6 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:14.325986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befa43b-2afd-41ab-973b-570985141af6 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:14.343849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70261cbc-c4a6-467e-b8d3-e1f75f53845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:14.345085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261cbc-c4a6-467e-b8d3-e1f75f53845b admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:14.345710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261cbc-c4a6-467e-b8d3-e1f75f53845b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:14.346229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261cbc-c4a6-467e-b8d3-e1f75f53845b admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:14.347221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70261cbc-c4a6-467e-b8d3-e1f75f53845b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:14.352197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70261cbc-c4a6-467e-b8d3-e1f75f53845b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:14.504178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2468-e82a-4882-8212-dd0ab871ed83 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:14.505442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 866/1716] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:14 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:14.522709 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2468-e82a-4882-8212-dd0ab871ed83 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:14.716208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54739a83-9c44-47e6-9055-9273ec2a486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:14.716208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739a83-9c44-47e6-9055-9273ec2a486f admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:14.716208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739a83-9c44-47e6-9055-9273ec2a486f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:14.716208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739a83-9c44-47e6-9055-9273ec2a486f admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:14.718675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54739a83-9c44-47e6-9055-9273ec2a486f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:14.718675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54739a83-9c44-47e6-9055-9273ec2a486f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:15.007775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 851/1717] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:14 2022] POST /identity/v3/users => generated 290 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:15.013482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70261cbc-c4a6-467e-b8d3-e1f75f53845b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:15.038157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70261cbc-c4a6-467e-b8d3-e1f75f53845b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:15.059436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cebdbe-d669-4998-88ae-ef61362e0186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:15.060172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cebdbe-d669-4998-88ae-ef61362e0186 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:15.060457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cebdbe-d669-4998-88ae-ef61362e0186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:15.060749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cebdbe-d669-4998-88ae-ef61362e0186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:15.065104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cebdbe-d669-4998-88ae-ef61362e0186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:15.072754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cebdbe-d669-4998-88ae-ef61362e0186 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:15.143567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54739a83-9c44-47e6-9055-9273ec2a486f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:15.153448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 867/1718] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:15.172771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54739a83-9c44-47e6-9055-9273ec2a486f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:15.205937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb69b4-2226-400d-9abc-ef4af2512cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:15.212419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb69b4-2226-400d-9abc-ef4af2512cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:15.212749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb69b4-2226-400d-9abc-ef4af2512cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:15.217767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb69b4-2226-400d-9abc-ef4af2512cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:15.218391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb69b4-2226-400d-9abc-ef4af2512cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:15.224690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb69b4-2226-400d-9abc-ef4af2512cf4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:15.318986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 852/1719] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:15.322980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cebdbe-d669-4998-88ae-ef61362e0186 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:15.325936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:15.350586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cebdbe-d669-4998-88ae-ef61362e0186 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:15.375772 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e8363-c4fa-4bbe-9b06-e38fd29ecb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:15.376456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e8363-c4fa-4bbe-9b06-e38fd29ecb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:15.382279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e8363-c4fa-4bbe-9b06-e38fd29ecb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:15.384840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e8363-c4fa-4bbe-9b06-e38fd29ecb42 admin admin] PATH_INFO: `/v3/projects/0b8e1b3f2dac43fb886e69f491da5bd3/users/7be307f7392f4c5f8a111e61007fe358/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:15.479943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e8363-c4fa-4bbe-9b06-e38fd29ecb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8e1b3f2dac43fb886e69f491da5bd3, user_id=7be307f7392f4c5f8a111e61007fe358, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:15.499280 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e8363-c4fa-4bbe-9b06-e38fd29ecb42 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:15.625968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f8c1-e5f2-495c-bff8-74a0eefbe341 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:15.626527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f8c1-e5f2-495c-bff8-74a0eefbe341 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:15.626951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f8c1-e5f2-495c-bff8-74a0eefbe341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:15.631847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 868/1720] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:15 2022] PUT /identity/v3/projects/0b8e1b3f2dac43fb886e69f491da5bd3/users/7be307f7392f4c5f8a111e61007fe358/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:15.647337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686d9b7-c9a6-4e80-b7eb-727aedb3fcda None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:15.647939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686d9b7-c9a6-4e80-b7eb-727aedb3fcda None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:15.648514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686d9b7-c9a6-4e80-b7eb-727aedb3fcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:15.689977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fc14f8c1-e5f2-495c-bff8-74a0eefbe341 None None] MFA Rules not processed for user `aa8cd52bd9f24f7d8ed93943aaaeaa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:15.691557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fc14f8c1-e5f2-495c-bff8-74a0eefbe341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:15.808374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c686d9b7-c9a6-4e80-b7eb-727aedb3fcda None None] MFA Rules not processed for user `7be307f7392f4c5f8a111e61007fe358`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:15.809728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c686d9b7-c9a6-4e80-b7eb-727aedb3fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:15.827619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:15.892916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 853/1721] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Jul 25 23:04:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:15.925155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 869/1722] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:15.929905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14f8c1-e5f2-495c-bff8-74a0eefbe341 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:15.986919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686d9b7-c9a6-4e80-b7eb-727aedb3fcda None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:15.988986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c686d9b7-c9a6-4e80-b7eb-727aedb3fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:16.022160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686d9b7-c9a6-4e80-b7eb-727aedb3fcda None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:16.044230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501df6b-416f-4cde-89f6-7c7972522dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:16.045321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501df6b-416f-4cde-89f6-7c7972522dda service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:16.045814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501df6b-416f-4cde-89f6-7c7972522dda service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:16.047137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501df6b-416f-4cde-89f6-7c7972522dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:16.080104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501df6b-416f-4cde-89f6-7c7972522dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:16.086480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501df6b-416f-4cde-89f6-7c7972522dda service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:16.109379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14f8c1-e5f2-495c-bff8-74a0eefbe341 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:16.125642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbb53a-c796-494b-bee9-6bed7658cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:16.129950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbb53a-c796-494b-bee9-6bed7658cfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:16.129950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbb53a-c796-494b-bee9-6bed7658cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:16.129950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbb53a-c796-494b-bee9-6bed7658cfd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:16.130543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 870/1723] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:16.130647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbb53a-c796-494b-bee9-6bed7658cfd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:16.130891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501df6b-416f-4cde-89f6-7c7972522dda service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:16.132067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbb53a-c796-494b-bee9-6bed7658cfd4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:16.147567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501df6b-416f-4cde-89f6-7c7972522dda service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:16.154454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd34dd-e405-4722-a053-5f1040573b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:16.155447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd34dd-e405-4722-a053-5f1040573b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:16.155934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd34dd-e405-4722-a053-5f1040573b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:16.156572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd34dd-e405-4722-a053-5f1040573b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:16.174306 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd34dd-e405-4722-a053-5f1040573b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:16.177009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd34dd-e405-4722-a053-5f1040573b4f service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:16.207512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 871/1724] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:16.303917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 854/1725] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:15 2022] POST /identity/v3/projects => generated 381 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:16.307891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd34dd-e405-4722-a053-5f1040573b4f service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:16.325915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd34dd-e405-4722-a053-5f1040573b4f service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:16.392912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbb53a-c796-494b-bee9-6bed7658cfd4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:16.394776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3ddbb53a-c796-494b-bee9-6bed7658cfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:16.497443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d5c75-8213-4590-889e-d9d2d17e2680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:16.503010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5c75-8213-4590-889e-d9d2d17e2680 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:16.503010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5c75-8213-4590-889e-d9d2d17e2680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:16.503010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5c75-8213-4590-889e-d9d2d17e2680 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:16.503010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d5c75-8213-4590-889e-d9d2d17e2680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:16.503010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d5c75-8213-4590-889e-d9d2d17e2680 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:16.525080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbb53a-c796-494b-bee9-6bed7658cfd4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:16.540198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:16.541412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:16.541412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:16.542290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] PATH_INFO: `/v3/projects/c1eaeb0edc7741b09bb3c0ade2421aa9` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:16.551442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1eaeb0edc7741b09bb3c0ade2421aa9)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:16.561998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:16.637646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 872/1726] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:16 2022] POST /identity/v3/users => generated 297 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:16.640285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d5c75-8213-4590-889e-d9d2d17e2680 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:16.695637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d5c75-8213-4590-889e-d9d2d17e2680 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:16.708537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673393f-749f-4213-b368-3da0f8d2a642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:16.708537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673393f-749f-4213-b368-3da0f8d2a642 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:16.708537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673393f-749f-4213-b368-3da0f8d2a642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:16.708537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673393f-749f-4213-b368-3da0f8d2a642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:16.708825 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673393f-749f-4213-b368-3da0f8d2a642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:16.719019 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673393f-749f-4213-b368-3da0f8d2a642 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:16.753290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 873/1727] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:16.780934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673393f-749f-4213-b368-3da0f8d2a642 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:16.799350 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673393f-749f-4213-b368-3da0f8d2a642 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:16.835628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845515-1a41-4332-b397-0b3ce7e1e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:16.836622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845515-1a41-4332-b397-0b3ce7e1e2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:16.837189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845515-1a41-4332-b397-0b3ce7e1e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:16.839642 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845515-1a41-4332-b397-0b3ce7e1e2c6 admin admin] PATH_INFO: `/v3/projects/50483ab81b154a21a2c84d5e2a48d832/users/e721539bed2546f094e05f8f20503672/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:16.904293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1eaeb0edc7741b09bb3c0ade2421aa9', 'request_id': 'req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:16.911134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9845515-1a41-4332-b397-0b3ce7e1e2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50483ab81b154a21a2c84d5e2a48d832, user_id=e721539bed2546f094e05f8f20503672, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:16.919919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9845515-1a41-4332-b397-0b3ce7e1e2c6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:16.921769 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1eaeb0edc7741b09bb3c0ade2421aa9', 'request_id': 'req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:17.029908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1eaeb0edc7741b09bb3c0ade2421aa9', 'request_id': 'req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:17.037694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 874/1728] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:16 2022] PUT /identity/v3/projects/50483ab81b154a21a2c84d5e2a48d832/users/e721539bed2546f094e05f8f20503672/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:17.042956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845515-1a41-4332-b397-0b3ce7e1e2c6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:17.046513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] The token cache is being invalidate because project c1eaeb0edc7741b09bb3c0ade2421aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:17.048531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:17.050309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:17.054970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 855/1729] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:16 2022] DELETE /identity/v3/projects/c1eaeb0edc7741b09bb3c0ade2421aa9 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:17.060859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:17.063120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:17.166464 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:17.229108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:17.305003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845515-1a41-4332-b397-0b3ce7e1e2c6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:17.314562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc0080-ceb5-4a3a-931b-29dcb42cd962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:17.315401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc0080-ceb5-4a3a-931b-29dcb42cd962 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:17.315729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc0080-ceb5-4a3a-931b-29dcb42cd962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:17.316130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc0080-ceb5-4a3a-931b-29dcb42cd962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:17.320501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfc6a8-a7d6-4bef-b3c2-767be36145a7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:17.322459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc0080-ceb5-4a3a-931b-29dcb42cd962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:17.329623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc0080-ceb5-4a3a-931b-29dcb42cd962 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:17.335828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:17.336486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:17.336805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:17.337087 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] PATH_INFO: `/v3/users/de81ab2b3e3f48018b3b3d3cc4d52fce` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:17.342774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=de81ab2b3e3f48018b3b3d3cc4d52fce)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:17.348134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:17.353954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 875/1730] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:17.360113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc0080-ceb5-4a3a-931b-29dcb42cd962 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:17.363819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8ecc0080-ceb5-4a3a-931b-29dcb42cd962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:17.445754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc0080-ceb5-4a3a-931b-29dcb42cd962 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:17.465764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aadbf3-bf0a-4920-9cc6-c9ce4fd336b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:17.466520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aadbf3-bf0a-4920-9cc6-c9ce4fd336b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:17.467508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aadbf3-bf0a-4920-9cc6-c9ce4fd336b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:17.467508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aadbf3-bf0a-4920-9cc6-c9ce4fd336b5 admin admin] PATH_INFO: `/v3/projects/50483ab81b154a21a2c84d5e2a48d832/users/e721539bed2546f094e05f8f20503672/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:17.486492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aadbf3-bf0a-4920-9cc6-c9ce4fd336b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50483ab81b154a21a2c84d5e2a48d832, user_id=e721539bed2546f094e05f8f20503672, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:17.497608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aadbf3-bf0a-4920-9cc6-c9ce4fd336b5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:17.528480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 876/1731] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:17 2022] PUT /identity/v3/projects/50483ab81b154a21a2c84d5e2a48d832/users/e721539bed2546f094e05f8f20503672/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:17.540041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3b9ed-1324-41b8-b3ae-bf8b273c3f5f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:17.540441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3b9ed-1324-41b8-b3ae-bf8b273c3f5f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:17.540790 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3b9ed-1324-41b8-b3ae-bf8b273c3f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:17.613754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-60b3b9ed-1324-41b8-b3ae-bf8b273c3f5f None None] MFA Rules not processed for user `e721539bed2546f094e05f8f20503672`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:17.636444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-60b3b9ed-1324-41b8-b3ae-bf8b273c3f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:17.793900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 877/1732] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:17.944768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de81ab2b3e3f48018b3b3d3cc4d52fce'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:17.946109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de81ab2b3e3f48018b3b3d3cc4d52fce'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:18.012856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43616c-5213-4605-9909-a1aa9b0727b9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:18.013270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43616c-5213-4605-9909-a1aa9b0727b9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:18.013640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43616c-5213-4605-9909-a1aa9b0727b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:18.068362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de81ab2b3e3f48018b3b3d3cc4d52fce'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:18.069689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2c43616c-5213-4605-9909-a1aa9b0727b9 None None] MFA Rules not processed for user `4eea5a29c87d431299b220e404fd5732`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:18.076326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2c43616c-5213-4605-9909-a1aa9b0727b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:18.090694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de81ab2b3e3f48018b3b3d3cc4d52fce'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:18.117146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de81ab2b3e3f48018b3b3d3cc4d52fce'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:18.135887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 856/1733] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:17 2022] DELETE /identity/v3/users/de81ab2b3e3f48018b3b3d3cc4d52fce => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:18.137415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:18.142877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:18.328105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 878/1734] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:18.334503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0865c67-6829-4d79-bebe-570c7ea29aea admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:18.350395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baecb5-e100-4aa8-92c3-5a4b3f6a368e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:18.351963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baecb5-e100-4aa8-92c3-5a4b3f6a368e service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:18.353524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baecb5-e100-4aa8-92c3-5a4b3f6a368e service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:18.354457 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baecb5-e100-4aa8-92c3-5a4b3f6a368e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:18.365905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-77baecb5-e100-4aa8-92c3-5a4b3f6a368e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:18.588487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baecb5-e100-4aa8-92c3-5a4b3f6a368e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:18.590139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baecb5-e100-4aa8-92c3-5a4b3f6a368e service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:18.625698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 857/1735] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:18.936949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:19.034372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184177c-0344-43aa-ab37-491498beed1b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:19.034705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184177c-0344-43aa-ab37-491498beed1b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:19.035573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184177c-0344-43aa-ab37-491498beed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:19.090478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3184177c-0344-43aa-ab37-491498beed1b None None] MFA Rules not processed for user `fbc4fc1f207c4726b9c05b6b338f0e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:19.095229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3184177c-0344-43aa-ab37-491498beed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:19.238965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:19.265187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 879/1736] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:19.493012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8d40-0684-4191-b948-ccac9354f925 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:19.493609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8d40-0684-4191-b948-ccac9354f925 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:19.493609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8d40-0684-4191-b948-ccac9354f925 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:19.496117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 858/1737] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 23:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:04:19.720857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184177c-0344-43aa-ab37-491498beed1b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:19.722513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3184177c-0344-43aa-ab37-491498beed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:19.893629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184177c-0344-43aa-ab37-491498beed1b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:19.901274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:19.902392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:19.905676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:19.905676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] PATH_INFO: `/v3/users/2377949db6984bb5a71066c947a27192` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:19.905676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2377949db6984bb5a71066c947a27192)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:19.908061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:19.968222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3f402-755b-4116-a47c-18018af97876 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:19.968725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3f402-755b-4116-a47c-18018af97876 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:19.969203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3f402-755b-4116-a47c-18018af97876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:20.043728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a0d3f402-755b-4116-a47c-18018af97876 None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:20.044825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0d3f402-755b-4116-a47c-18018af97876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:20.194945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2377949db6984bb5a71066c947a27192'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:20.213303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2377949db6984bb5a71066c947a27192'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:20.252472 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 859/1738] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 23:04:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:20.383051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2377949db6984bb5a71066c947a27192'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:20.383051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2377949db6984bb5a71066c947a27192'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:20.383051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2377949db6984bb5a71066c947a27192'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:20.426692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 880/1739] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:19 2022] DELETE /identity/v3/users/2377949db6984bb5a71066c947a27192 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:20.431493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939005e6-a51c-4c57-8938-3529b0ab1e1e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:20.431957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939005e6-a51c-4c57-8938-3529b0ab1e1e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:20.433100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939005e6-a51c-4c57-8938-3529b0ab1e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:20.496696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-939005e6-a51c-4c57-8938-3529b0ab1e1e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:20.505887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-939005e6-a51c-4c57-8938-3529b0ab1e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:20.547587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:20.556783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:20.743424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 860/1740] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:20.780665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87642e6-932b-4a3e-822e-e2803795551a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:20.805021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacd1c1-e6ca-417d-a210-d60b9f7d998c tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e721539bed2546f094e05f8f20503672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50483ab81b154a21a2c84d5e2a48d832', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:20.806666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacd1c1-e6ca-417d-a210-d60b9f7d998c tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:20.806666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacd1c1-e6ca-417d-a210-d60b9f7d998c tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:20.807277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacd1c1-e6ca-417d-a210-d60b9f7d998c tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:20.808535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacd1c1-e6ca-417d-a210-d60b9f7d998c tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:20.810101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacd1c1-e6ca-417d-a210-d60b9f7d998c tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:20.815361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939005e6-a51c-4c57-8938-3529b0ab1e1e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:20.817835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-939005e6-a51c-4c57-8938-3529b0ab1e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:20.830108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacd1c1-e6ca-417d-a210-d60b9f7d998c tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:20.934559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 881/1741] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:20.937910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacd1c1-e6ca-417d-a210-d60b9f7d998c tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:20.972588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacd1c1-e6ca-417d-a210-d60b9f7d998c tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:20.991258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb087a1-f306-4078-9a59-2bfcb55cb3dc tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e721539bed2546f094e05f8f20503672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50483ab81b154a21a2c84d5e2a48d832', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:21.001803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb087a1-f306-4078-9a59-2bfcb55cb3dc tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:21.002283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb087a1-f306-4078-9a59-2bfcb55cb3dc tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:21.004985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb087a1-f306-4078-9a59-2bfcb55cb3dc tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:21.008258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb087a1-f306-4078-9a59-2bfcb55cb3dc tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:21.015276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb087a1-f306-4078-9a59-2bfcb55cb3dc tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:21.077082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939005e6-a51c-4c57-8938-3529b0ab1e1e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:21.083995 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5ff63-3b71-4d96-b548-c518016ddf00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:21.085630 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5ff63-3b71-4d96-b548-c518016ddf00 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:21.086526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5ff63-3b71-4d96-b548-c518016ddf00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:21.087003 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5ff63-3b71-4d96-b548-c518016ddf00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:21.110437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5ff63-3b71-4d96-b548-c518016ddf00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:21.117491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5ff63-3b71-4d96-b548-c518016ddf00 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:21.154104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 882/1742] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:20 2022] POST /identity/v3/projects => generated 353 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:21.156117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 861/1743] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:21.159880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb087a1-f306-4078-9a59-2bfcb55cb3dc tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:21.436248 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e593-9c8d-4e79-814e-d8661976b1c4 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:21.437235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e593-9c8d-4e79-814e-d8661976b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:21.437953 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e593-9c8d-4e79-814e-d8661976b1c4 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:21.442475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 862/1744] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 23:04:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:04:21.456116 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb087a1-f306-4078-9a59-2bfcb55cb3dc tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:21.487309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499042b-9a7c-4ab7-88d0-175dc6f78758 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e721539bed2546f094e05f8f20503672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50483ab81b154a21a2c84d5e2a48d832', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:21.491187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499042b-9a7c-4ab7-88d0-175dc6f78758 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:21.495115 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499042b-9a7c-4ab7-88d0-175dc6f78758 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:21.495591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499042b-9a7c-4ab7-88d0-175dc6f78758 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:21.496509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499042b-9a7c-4ab7-88d0-175dc6f78758 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:21.511617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499042b-9a7c-4ab7-88d0-175dc6f78758 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:21.513604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499042b-9a7c-4ab7-88d0-175dc6f78758 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:21.516087 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4e37d-7c3a-46d3-b666-2ecbc874c70c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:21.517256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4e37d-7c3a-46d3-b666-2ecbc874c70c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:21.517888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4e37d-7c3a-46d3-b666-2ecbc874c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:21.605933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-93f4e37d-7c3a-46d3-b666-2ecbc874c70c None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:21.612830 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-93f4e37d-7c3a-46d3-b666-2ecbc874c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:21.638184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 883/1745] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:21.758686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:21.769783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499042b-9a7c-4ab7-88d0-175dc6f78758 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:21.806155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499042b-9a7c-4ab7-88d0-175dc6f78758 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:21.824940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 863/1746] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 23:04:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:21.849099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e721539bed2546f094e05f8f20503672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50483ab81b154a21a2c84d5e2a48d832', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:21.851336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:21.851629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:21.851913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] PATH_INFO: `/v3/projects/fd38c5f5cb1b4f80a61a4f7d073015ac` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:21.884205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd38c5f5cb1b4f80a61a4f7d073015ac)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:21.886360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:22.192911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd38c5f5cb1b4f80a61a4f7d073015ac', 'request_id': 'req-3293564b-0add-4d97-a9b4-ebc3bb978a22'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:22.252716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd38c5f5cb1b4f80a61a4f7d073015ac', 'request_id': 'req-3293564b-0add-4d97-a9b4-ebc3bb978a22'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:22.252716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd38c5f5cb1b4f80a61a4f7d073015ac', 'request_id': 'req-3293564b-0add-4d97-a9b4-ebc3bb978a22'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:22.874113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] The token cache is being invalidate because project fd38c5f5cb1b4f80a61a4f7d073015ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:22.875520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:22.877338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:22.891483 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 884/1747] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:21 2022] DELETE /identity/v3/projects/fd38c5f5cb1b4f80a61a4f7d073015ac => generated 0 bytes in 1128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:22.911086 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4e37d-7c3a-46d3-b666-2ecbc874c70c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:22.913080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-93f4e37d-7c3a-46d3-b666-2ecbc874c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:23.010449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:23.012998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:23.098280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4e37d-7c3a-46d3-b666-2ecbc874c70c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:23.354363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293564b-0add-4d97-a9b4-ebc3bb978a22 tempest-VolumeQuotaClassesTest-1625228850 tempest-VolumeQuotaClassesTest-1625228850-project-admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:23.357412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:23.359508 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:23.364524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:23.365596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] PATH_INFO: `/v3/projects/910e33210f434e2daad950dd7c368587` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:23.367434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=910e33210f434e2daad950dd7c368587)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:23.371453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89c4d2-8a1d-4ac5-8c0a-f808fd86d094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:23.375161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c4d2-8a1d-4ac5-8c0a-f808fd86d094 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:23.375161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c4d2-8a1d-4ac5-8c0a-f808fd86d094 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:23.375161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c4d2-8a1d-4ac5-8c0a-f808fd86d094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:23.375466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:23.378747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ca89c4d2-8a1d-4ac5-8c0a-f808fd86d094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:23.426294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89c4d2-8a1d-4ac5-8c0a-f808fd86d094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:23.428699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89c4d2-8a1d-4ac5-8c0a-f808fd86d094 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:23.457425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:23.475919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 885/1748] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:23.587536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910e33210f434e2daad950dd7c368587', 'request_id': 'req-a470305f-39be-48ee-b058-b334f20daca3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:23.612096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910e33210f434e2daad950dd7c368587', 'request_id': 'req-a470305f-39be-48ee-b058-b334f20daca3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:23.613374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89c4d2-8a1d-4ac5-8c0a-f808fd86d094 service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:23.615101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ca89c4d2-8a1d-4ac5-8c0a-f808fd86d094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:23.643839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89c4d2-8a1d-4ac5-8c0a-f808fd86d094 service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:23.759659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910e33210f434e2daad950dd7c368587', 'request_id': 'req-a470305f-39be-48ee-b058-b334f20daca3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:23.805690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] The token cache is being invalidate because project 910e33210f434e2daad950dd7c368587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:23.805690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:23.809288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a470305f-39be-48ee-b058-b334f20daca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:23.811508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:23.812181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:23.812462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:23.812739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] PATH_INFO: `/v3/projects/f6bbe855c5fb42e8bbbf913d06dcbecc` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:23.817777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 864/1749] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:22 2022] DELETE /identity/v3/projects/910e33210f434e2daad950dd7c368587 => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:23.817924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bbe855c5fb42e8bbbf913d06dcbecc)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:23.817924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:23.820737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999de03-618d-4a53-b689-c1e0168aded6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:23.821032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999de03-618d-4a53-b689-c1e0168aded6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:23.821520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999de03-618d-4a53-b689-c1e0168aded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:23.922033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c999de03-618d-4a53-b689-c1e0168aded6 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:23.928885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c999de03-618d-4a53-b689-c1e0168aded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:23.980487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 865/1750] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:23.980487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9085-a929-4460-8e38-b134bb0b23fa None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:23.980487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9085-a929-4460-8e38-b134bb0b23fa None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:23.980487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9085-a929-4460-8e38-b134bb0b23fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:24.014033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b90b9085-a929-4460-8e38-b134bb0b23fa None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:24.015893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b90b9085-a929-4460-8e38-b134bb0b23fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:24.044468 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bbe855c5fb42e8bbbf913d06dcbecc', 'request_id': 'req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:24.062554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bbe855c5fb42e8bbbf913d06dcbecc', 'request_id': 'req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:24.080269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bbe855c5fb42e8bbbf913d06dcbecc', 'request_id': 'req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:24.181578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] The token cache is being invalidate because project f6bbe855c5fb42e8bbbf913d06dcbecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:24.182417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:24.185923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:24.187567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 886/1751] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:23 2022] DELETE /identity/v3/projects/f6bbe855c5fb42e8bbbf913d06dcbecc => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:24.188663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:24.194368 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:24.219983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 866/1752] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:24.223109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723de705-9609-4236-aa50-eadc3f0868f6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:24.223456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723de705-9609-4236-aa50-eadc3f0868f6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:24.223733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723de705-9609-4236-aa50-eadc3f0868f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:24.307772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-723de705-9609-4236-aa50-eadc3f0868f6 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:24.313402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-723de705-9609-4236-aa50-eadc3f0868f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:24.329437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28461b6d-81e1-4d3c-9d4d-78b01b7d877f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:24.339464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:24.340304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:24.340761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:24.341322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] PATH_INFO: `/v3/users/7be307f7392f4c5f8a111e61007fe358` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:24.347326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 867/1753] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:24.348710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723de705-9609-4236-aa50-eadc3f0868f6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:24.348943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be307f7392f4c5f8a111e61007fe358)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:24.353587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:24.398391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723de705-9609-4236-aa50-eadc3f0868f6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:24.407689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e99d0e-9130-4a12-8ee8-8b966209660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:24.408500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99d0e-9130-4a12-8ee8-8b966209660f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:24.408821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99d0e-9130-4a12-8ee8-8b966209660f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:24.409103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99d0e-9130-4a12-8ee8-8b966209660f admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:24.410005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e99d0e-9130-4a12-8ee8-8b966209660f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:24.410182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e99d0e-9130-4a12-8ee8-8b966209660f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:24.412268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e99d0e-9130-4a12-8ee8-8b966209660f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:24.443500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 868/1754] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:24.444913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6ab4-39ce-430c-9c36-b68fd61d2e07 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:24.445232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6ab4-39ce-430c-9c36-b68fd61d2e07 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:24.445501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6ab4-39ce-430c-9c36-b68fd61d2e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:24.504793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2ccf6ab4-39ce-430c-9c36-b68fd61d2e07 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:24.506413 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2ccf6ab4-39ce-430c-9c36-b68fd61d2e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:24.535092 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 869/1755] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:24.536276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf6ab4-39ce-430c-9c36-b68fd61d2e07 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:24.561095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf6ab4-39ce-430c-9c36-b68fd61d2e07 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:24.587362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3451f4d-e6bb-4b3d-b4a9-8250d6255944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:24.589451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3451f4d-e6bb-4b3d-b4a9-8250d6255944 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:24.589745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3451f4d-e6bb-4b3d-b4a9-8250d6255944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:24.591069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3451f4d-e6bb-4b3d-b4a9-8250d6255944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:24.591805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3451f4d-e6bb-4b3d-b4a9-8250d6255944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:24.597558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3451f4d-e6bb-4b3d-b4a9-8250d6255944 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:24.855936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 870/1756] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:24 2022] POST /identity/v3/projects => generated 377 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:24.855936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3451f4d-e6bb-4b3d-b4a9-8250d6255944 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:25.001457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be307f7392f4c5f8a111e61007fe358'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:25.008570 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3451f4d-e6bb-4b3d-b4a9-8250d6255944 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:25.017632 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd200a3-ad67-4b2c-8bfa-2163844b33c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:25.018367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd200a3-ad67-4b2c-8bfa-2163844b33c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:25.018557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd200a3-ad67-4b2c-8bfa-2163844b33c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:25.019010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd200a3-ad67-4b2c-8bfa-2163844b33c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:25.019911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd200a3-ad67-4b2c-8bfa-2163844b33c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:25.020313 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd200a3-ad67-4b2c-8bfa-2163844b33c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:25.041283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd200a3-ad67-4b2c-8bfa-2163844b33c9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:25.057437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be307f7392f4c5f8a111e61007fe358'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:25.098682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 871/1757] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:25.100967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd200a3-ad67-4b2c-8bfa-2163844b33c9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:25.141914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd200a3-ad67-4b2c-8bfa-2163844b33c9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:25.154652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be307f7392f4c5f8a111e61007fe358'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:25.159563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be307f7392f4c5f8a111e61007fe358'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:25.159563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be307f7392f4c5f8a111e61007fe358'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:25.160986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c48957-ff04-4047-bb47-bc0081fb94b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:25.161917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c48957-ff04-4047-bb47-bc0081fb94b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:25.162220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c48957-ff04-4047-bb47-bc0081fb94b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:25.162549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c48957-ff04-4047-bb47-bc0081fb94b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:25.164258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c48957-ff04-4047-bb47-bc0081fb94b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:25.168084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c48957-ff04-4047-bb47-bc0081fb94b3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:25.188289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 887/1758] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:24 2022] DELETE /identity/v3/users/7be307f7392f4c5f8a111e61007fe358 => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:25.194315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:25.199354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:25.321224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 872/1759] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:25 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:25.324865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c48957-ff04-4047-bb47-bc0081fb94b3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:25.327277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7149f29-d864-4eb0-9409-7736f8f0f144 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:25.330427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-78c48957-ff04-4047-bb47-bc0081fb94b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:25.338899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456153-4046-438e-ad94-abf9f9778166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:25.339569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456153-4046-438e-ad94-abf9f9778166 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:25.339859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456153-4046-438e-ad94-abf9f9778166 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:25.343293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456153-4046-438e-ad94-abf9f9778166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:25.345823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4e456153-4046-438e-ad94-abf9f9778166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:25.363372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e456153-4046-438e-ad94-abf9f9778166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:25.364027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e456153-4046-438e-ad94-abf9f9778166 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:25.380971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 888/1760] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:25.382656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5175-3849-4733-ac1e-684109f452dc None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:25.383049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5175-3849-4733-ac1e-684109f452dc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:25.383327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5175-3849-4733-ac1e-684109f452dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:25.416298 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c48957-ff04-4047-bb47-bc0081fb94b3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:25.455507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-039c5175-3849-4733-ac1e-684109f452dc None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:25.458616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-039c5175-3849-4733-ac1e-684109f452dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:25.582303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8433ff-e2da-4174-9c37-7a192e02404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:25.584270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8433ff-e2da-4174-9c37-7a192e02404d admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:25.584637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8433ff-e2da-4174-9c37-7a192e02404d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:25.584929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8433ff-e2da-4174-9c37-7a192e02404d admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:25.585875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8433ff-e2da-4174-9c37-7a192e02404d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:25.589359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8433ff-e2da-4174-9c37-7a192e02404d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:25.650103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 889/1761] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:25.650103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5175-3849-4733-ac1e-684109f452dc None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:25.650103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-039c5175-3849-4733-ac1e-684109f452dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:25.664547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5175-3849-4733-ac1e-684109f452dc None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:25.671910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa71bd-6add-47ed-881b-e9614a704cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:25.672764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa71bd-6add-47ed-881b-e9614a704cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:25.673166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa71bd-6add-47ed-881b-e9614a704cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:25.673547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa71bd-6add-47ed-881b-e9614a704cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:25.674943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa71bd-6add-47ed-881b-e9614a704cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:25.677515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa71bd-6add-47ed-881b-e9614a704cf4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:25.691769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 890/1762] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:25.693006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa71bd-6add-47ed-881b-e9614a704cf4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:25.702888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5daa71bd-6add-47ed-881b-e9614a704cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:25.748429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 873/1763] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:25 2022] POST /identity/v3/projects => generated 405 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:25.749205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8433ff-e2da-4174-9c37-7a192e02404d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:25.871207 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa71bd-6add-47ed-881b-e9614a704cf4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:25.904751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8433ff-e2da-4174-9c37-7a192e02404d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:25.914034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:25.924220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e117ba-91b5-4d71-b878-984b3952a399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:25.925145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e117ba-91b5-4d71-b878-984b3952a399 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:25.925585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e117ba-91b5-4d71-b878-984b3952a399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:25.926017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e117ba-91b5-4d71-b878-984b3952a399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:25.926873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e117ba-91b5-4d71-b878-984b3952a399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:25.930970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e117ba-91b5-4d71-b878-984b3952a399 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:25.957596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 874/1764] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:25.958906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e117ba-91b5-4d71-b878-984b3952a399 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:25.979232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e117ba-91b5-4d71-b878-984b3952a399 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:26.006246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640f4bb-58b4-4b63-baa5-133022dbffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:26.009514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640f4bb-58b4-4b63-baa5-133022dbffc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:26.010722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640f4bb-58b4-4b63-baa5-133022dbffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:26.012474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640f4bb-58b4-4b63-baa5-133022dbffc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:26.013513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640f4bb-58b4-4b63-baa5-133022dbffc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:26.024294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640f4bb-58b4-4b63-baa5-133022dbffc4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:26.102958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:26.126248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611c8e0-fca5-4992-be97-37fea6b3cb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:26.127003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611c8e0-fca5-4992-be97-37fea6b3cb3a service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:26.127379 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611c8e0-fca5-4992-be97-37fea6b3cb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:26.127748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611c8e0-fca5-4992-be97-37fea6b3cb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:26.159932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611c8e0-fca5-4992-be97-37fea6b3cb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:26.162898 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611c8e0-fca5-4992-be97-37fea6b3cb3a service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:26.169893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 875/1765] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:25 2022] POST /identity/v3/users => generated 303 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:26.175770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640f4bb-58b4-4b63-baa5-133022dbffc4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:26.210226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 891/1766] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:26.211967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611c8e0-fca5-4992-be97-37fea6b3cb3a service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:26.212415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640f4bb-58b4-4b63-baa5-133022dbffc4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:26.226966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155511f-7911-441a-bb41-1c7b2bb2c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:26.227936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155511f-7911-441a-bb41-1c7b2bb2c61b admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:26.229388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155511f-7911-441a-bb41-1c7b2bb2c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:26.230516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155511f-7911-441a-bb41-1c7b2bb2c61b admin admin] PATH_INFO: `/v3/projects/bc201b313634472e816c1a4ad98ec603/users/0c78dc942dc5435eadad651a3104080e/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:26.236844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611c8e0-fca5-4992-be97-37fea6b3cb3a service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:26.243202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12627ed2-5882-4986-af06-f9f338600fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:26.243893 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12627ed2-5882-4986-af06-f9f338600fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:26.245051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12627ed2-5882-4986-af06-f9f338600fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:26.245740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12627ed2-5882-4986-af06-f9f338600fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:26.251703 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12627ed2-5882-4986-af06-f9f338600fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:26.254132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12627ed2-5882-4986-af06-f9f338600fb2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:26.269048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 892/1767] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:26.274210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12627ed2-5882-4986-af06-f9f338600fb2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:26.285518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155511f-7911-441a-bb41-1c7b2bb2c61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc201b313634472e816c1a4ad98ec603, user_id=0c78dc942dc5435eadad651a3104080e, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:26.305061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155511f-7911-441a-bb41-1c7b2bb2c61b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:26.305355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12627ed2-5882-4986-af06-f9f338600fb2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:26.328783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00e8f7-9abc-4adb-a42f-986ea3163870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:26.330326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00e8f7-9abc-4adb-a42f-986ea3163870 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:26.330613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00e8f7-9abc-4adb-a42f-986ea3163870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:26.330942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00e8f7-9abc-4adb-a42f-986ea3163870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:26.331666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00e8f7-9abc-4adb-a42f-986ea3163870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:26.345711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00e8f7-9abc-4adb-a42f-986ea3163870 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:26.384424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 893/1768] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:26.386687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00e8f7-9abc-4adb-a42f-986ea3163870 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:26.413161 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 876/1769] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:26 2022] PUT /identity/v3/projects/bc201b313634472e816c1a4ad98ec603/users/0c78dc942dc5435eadad651a3104080e/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:26.418614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00e8f7-9abc-4adb-a42f-986ea3163870 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:26.424449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398b5f2-882a-4fa1-80de-7dcfce96d194 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:26.424943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398b5f2-882a-4fa1-80de-7dcfce96d194 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:26.425744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398b5f2-882a-4fa1-80de-7dcfce96d194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:26.494061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c398b5f2-882a-4fa1-80de-7dcfce96d194 None None] MFA Rules not processed for user `0c78dc942dc5435eadad651a3104080e`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:26.496375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c398b5f2-882a-4fa1-80de-7dcfce96d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:26.596048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae302abb-63b6-40ab-b845-df9908df4921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:26.596701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae302abb-63b6-40ab-b845-df9908df4921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:26.596984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae302abb-63b6-40ab-b845-df9908df4921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:26.597290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae302abb-63b6-40ab-b845-df9908df4921 admin admin] PATH_INFO: `/v3/projects/6cc77d7da9dc477cbd5f1c439701ff63/users/18ac365708214d0689be268d5969355c/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:26.621377 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae302abb-63b6-40ab-b845-df9908df4921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc77d7da9dc477cbd5f1c439701ff63, user_id=18ac365708214d0689be268d5969355c, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:26.624284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae302abb-63b6-40ab-b845-df9908df4921 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:26.701466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 877/1770] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:26.711199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398b5f2-882a-4fa1-80de-7dcfce96d194 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:26.737272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 894/1771] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:26 2022] PUT /identity/v3/projects/6cc77d7da9dc477cbd5f1c439701ff63/users/18ac365708214d0689be268d5969355c/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:26.741905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398b5f2-882a-4fa1-80de-7dcfce96d194 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:26.747266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73457ef7-3f15-4fc4-9300-9fb8d5b2ecc8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:26.747587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73457ef7-3f15-4fc4-9300-9fb8d5b2ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:26.747862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73457ef7-3f15-4fc4-9300-9fb8d5b2ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:26.786528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:26.828728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-73457ef7-3f15-4fc4-9300-9fb8d5b2ecc8 None None] MFA Rules not processed for user `18ac365708214d0689be268d5969355c`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:26.830294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-73457ef7-3f15-4fc4-9300-9fb8d5b2ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:26.972613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698ad67-0236-4867-aa5f-0da4d5308dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:26.972613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698ad67-0236-4867-aa5f-0da4d5308dec admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:26.972613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698ad67-0236-4867-aa5f-0da4d5308dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:26.972613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698ad67-0236-4867-aa5f-0da4d5308dec admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:26.973048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698ad67-0236-4867-aa5f-0da4d5308dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:26.973048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698ad67-0236-4867-aa5f-0da4d5308dec admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:27.009066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 895/1772] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:27.014160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73457ef7-3f15-4fc4-9300-9fb8d5b2ecc8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:27.035384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73457ef7-3f15-4fc4-9300-9fb8d5b2ecc8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:27.040757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4d0c9-0221-4c1d-bde1-793fb42ef651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:27.041588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4d0c9-0221-4c1d-bde1-793fb42ef651 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:27.041991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4d0c9-0221-4c1d-bde1-793fb42ef651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:27.042577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4d0c9-0221-4c1d-bde1-793fb42ef651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:27.043261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4d0c9-0221-4c1d-bde1-793fb42ef651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:27.045218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4d0c9-0221-4c1d-bde1-793fb42ef651 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:27.322841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 878/1773] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:26 2022] POST /identity/v3/projects => generated 375 bytes in 614 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:27.355128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 896/1774] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:27 2022] POST /identity/v3/projects => generated 405 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:27.356151 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698ad67-0236-4867-aa5f-0da4d5308dec admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:27.356675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4d0c9-0221-4c1d-bde1-793fb42ef651 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:27.574340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4d0c9-0221-4c1d-bde1-793fb42ef651 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:27.592987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f5274-27dc-499e-b4f6-8ef8757db91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:27.595489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f5274-27dc-499e-b4f6-8ef8757db91e admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:27.595779 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f5274-27dc-499e-b4f6-8ef8757db91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:27.596062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f5274-27dc-499e-b4f6-8ef8757db91e admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:27.596752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f5274-27dc-499e-b4f6-8ef8757db91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:27.599867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698ad67-0236-4867-aa5f-0da4d5308dec admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:27.608836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f5274-27dc-499e-b4f6-8ef8757db91e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:27.614134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8881529-62ed-45e5-b798-68b0641d3820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:27.614134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8881529-62ed-45e5-b798-68b0641d3820 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:27.614134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8881529-62ed-45e5-b798-68b0641d3820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:27.614134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8881529-62ed-45e5-b798-68b0641d3820 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:27.614731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8881529-62ed-45e5-b798-68b0641d3820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:27.617256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8881529-62ed-45e5-b798-68b0641d3820 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:27.737175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 879/1775] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:27 2022] POST /identity/v3/users => generated 294 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:27.738203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8881529-62ed-45e5-b798-68b0641d3820 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:27.766093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8881529-62ed-45e5-b798-68b0641d3820 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:27.796751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0439dd-24af-4393-a4f9-a2c603f82ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:27.797817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 897/1776] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:27 2022] POST /identity/v3/users => generated 309 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:27.802402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f5274-27dc-499e-b4f6-8ef8757db91e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:27.802712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0439dd-24af-4393-a4f9-a2c603f82ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:27.803007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0439dd-24af-4393-a4f9-a2c603f82ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:27.803306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0439dd-24af-4393-a4f9-a2c603f82ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:27.804024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0439dd-24af-4393-a4f9-a2c603f82ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:27.810705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0439dd-24af-4393-a4f9-a2c603f82ecb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:27.823788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f5274-27dc-499e-b4f6-8ef8757db91e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:27.849953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefb863-459a-44f8-86c9-ceb00e7f6da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:27.851702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefb863-459a-44f8-86c9-ceb00e7f6da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:27.853396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefb863-459a-44f8-86c9-ceb00e7f6da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:27.857510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefb863-459a-44f8-86c9-ceb00e7f6da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:27.857510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefb863-459a-44f8-86c9-ceb00e7f6da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:27.858449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 880/1777] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:27.859915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0439dd-24af-4393-a4f9-a2c603f82ecb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:27.864757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefb863-459a-44f8-86c9-ceb00e7f6da2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:27.875274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0439dd-24af-4393-a4f9-a2c603f82ecb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:27.906308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58b71f-d59f-40ea-bee9-ec76e4ace6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:27.907968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58b71f-d59f-40ea-bee9-ec76e4ace6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:27.908845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58b71f-d59f-40ea-bee9-ec76e4ace6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:27.913652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 898/1778] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:27.915499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefb863-459a-44f8-86c9-ceb00e7f6da2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:27.915842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58b71f-d59f-40ea-bee9-ec76e4ace6ed admin admin] PATH_INFO: `/v3/projects/86f57f29eb0f4140b5655f9fad8e34f5/users/54e59e71d8c84729b2db4126be553efc/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:27.937925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefb863-459a-44f8-86c9-ceb00e7f6da2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:27.949861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58b71f-d59f-40ea-bee9-ec76e4ace6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f57f29eb0f4140b5655f9fad8e34f5, user_id=54e59e71d8c84729b2db4126be553efc, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:27.951665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68037a-317c-403e-ade6-cdba79c999c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:27.952325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68037a-317c-403e-ade6-cdba79c999c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:27.952609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68037a-317c-403e-ade6-cdba79c999c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:27.952889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68037a-317c-403e-ade6-cdba79c999c8 admin admin] PATH_INFO: `/v3/projects/8913e41a7db7437ebe6398deeccfaac1/users/be0b6a55549e4d6d8b0ab0cfab27871a/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:27.953777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58b71f-d59f-40ea-bee9-ec76e4ace6ed admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:28.000766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68037a-317c-403e-ade6-cdba79c999c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8913e41a7db7437ebe6398deeccfaac1, user_id=be0b6a55549e4d6d8b0ab0cfab27871a, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:28.006097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68037a-317c-403e-ade6-cdba79c999c8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:28.081526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 881/1779] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:27 2022] PUT /identity/v3/projects/86f57f29eb0f4140b5655f9fad8e34f5/users/54e59e71d8c84729b2db4126be553efc/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:28.085941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58b71f-d59f-40ea-bee9-ec76e4ace6ed admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:28.130728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 899/1780] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:27 2022] PUT /identity/v3/projects/8913e41a7db7437ebe6398deeccfaac1/users/be0b6a55549e4d6d8b0ab0cfab27871a/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:28.133714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68037a-317c-403e-ade6-cdba79c999c8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:28.216556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58b71f-d59f-40ea-bee9-ec76e4ace6ed admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:28.308099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68037a-317c-403e-ade6-cdba79c999c8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:28.327358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4603c-8ac9-4f64-926a-91b84929e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:28.328097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4603c-8ac9-4f64-926a-91b84929e6fa admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:28.328356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4603c-8ac9-4f64-926a-91b84929e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:28.328574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4603c-8ac9-4f64-926a-91b84929e6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:28.330818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4603c-8ac9-4f64-926a-91b84929e6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:28.335097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4603c-8ac9-4f64-926a-91b84929e6fa admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:28.365725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 900/1781] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:28.370487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4603c-8ac9-4f64-926a-91b84929e6fa admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:28.391047 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4603c-8ac9-4f64-926a-91b84929e6fa admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:28.406784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d017-0b17-449b-a75f-a56239451748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:28.407379 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d017-0b17-449b-a75f-a56239451748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:28.407666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d017-0b17-449b-a75f-a56239451748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:28.407978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d017-0b17-449b-a75f-a56239451748 admin admin] PATH_INFO: `/v3/projects/8913e41a7db7437ebe6398deeccfaac1/users/be0b6a55549e4d6d8b0ab0cfab27871a/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:28.409423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93b8fd-09d8-45e1-9458-983189ff4d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:28.410254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b8fd-09d8-45e1-9458-983189ff4d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:28.410509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b8fd-09d8-45e1-9458-983189ff4d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:28.410845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b8fd-09d8-45e1-9458-983189ff4d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:28.410997 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d017-0b17-449b-a75f-a56239451748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8913e41a7db7437ebe6398deeccfaac1, user_id=be0b6a55549e4d6d8b0ab0cfab27871a, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:28.411747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93b8fd-09d8-45e1-9458-983189ff4d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:28.413469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93b8fd-09d8-45e1-9458-983189ff4d66 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:28.414184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d017-0b17-449b-a75f-a56239451748 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:28.453185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 901/1782] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:28 2022] PUT /identity/v3/projects/8913e41a7db7437ebe6398deeccfaac1/users/be0b6a55549e4d6d8b0ab0cfab27871a/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:28.454100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 882/1783] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:28.470266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d017-0b17-449b-a75f-a56239451748 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:28.473530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bde75-cb88-43a4-8ca8-f4d4fde96979 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:28.474618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bde75-cb88-43a4-8ca8-f4d4fde96979 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:28.475116 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bde75-cb88-43a4-8ca8-f4d4fde96979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:28.558885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ab5bde75-cb88-43a4-8ca8-f4d4fde96979 None None] MFA Rules not processed for user `be0b6a55549e4d6d8b0ab0cfab27871a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:28.560227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ab5bde75-cb88-43a4-8ca8-f4d4fde96979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:28.632996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d017-0b17-449b-a75f-a56239451748 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:28.640270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2846af9-1ff8-4f29-ae05-946a45093bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:28.643563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846af9-1ff8-4f29-ae05-946a45093bae admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:28.643563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846af9-1ff8-4f29-ae05-946a45093bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:28.649369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846af9-1ff8-4f29-ae05-946a45093bae admin admin] PATH_INFO: `/v3/projects/86f57f29eb0f4140b5655f9fad8e34f5/users/54e59e71d8c84729b2db4126be553efc/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:28.649369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2846af9-1ff8-4f29-ae05-946a45093bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f57f29eb0f4140b5655f9fad8e34f5, user_id=54e59e71d8c84729b2db4126be553efc, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:28.649798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2846af9-1ff8-4f29-ae05-946a45093bae admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:28.684575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 883/1785] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:28 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:28.688848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bde75-cb88-43a4-8ca8-f4d4fde96979 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:28.688848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ab5bde75-cb88-43a4-8ca8-f4d4fde96979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:28.691668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 902/1785] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:28 2022] PUT /identity/v3/projects/86f57f29eb0f4140b5655f9fad8e34f5/users/54e59e71d8c84729b2db4126be553efc/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:28.693268 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc92c4f-da2b-4dba-8d73-a9c8fc62102b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:28.693562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc92c4f-da2b-4dba-8d73-a9c8fc62102b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:28.693836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc92c4f-da2b-4dba-8d73-a9c8fc62102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:28.714587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bde75-cb88-43a4-8ca8-f4d4fde96979 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:28.735410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-dbc92c4f-da2b-4dba-8d73-a9c8fc62102b None None] MFA Rules not processed for user `54e59e71d8c84729b2db4126be553efc`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:28.736564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-dbc92c4f-da2b-4dba-8d73-a9c8fc62102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:28.771416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:28.874562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:28.875393 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:28.875780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:28.876176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] PATH_INFO: `/v3/projects/0b8e1b3f2dac43fb886e69f491da5bd3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:28.877770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8e1b3f2dac43fb886e69f491da5bd3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:28.880489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:28.943207 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 903/1786] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:28.943207 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc92c4f-da2b-4dba-8d73-a9c8fc62102b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:28.944121 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-dbc92c4f-da2b-4dba-8d73-a9c8fc62102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:29.027316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8e1b3f2dac43fb886e69f491da5bd3', 'request_id': 'req-ef97f219-0ed9-45b1-b201-486f622393ff'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:29.036793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8e1b3f2dac43fb886e69f491da5bd3', 'request_id': 'req-ef97f219-0ed9-45b1-b201-486f622393ff'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:29.099338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc92c4f-da2b-4dba-8d73-a9c8fc62102b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:29.134080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:29.135791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8e1b3f2dac43fb886e69f491da5bd3', 'request_id': 'req-ef97f219-0ed9-45b1-b201-486f622393ff'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:29.157665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] The token cache is being invalidate because project 0b8e1b3f2dac43fb886e69f491da5bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:29.158283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:29.159571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:29.164345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 884/1787] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:28 2022] DELETE /identity/v3/projects/0b8e1b3f2dac43fb886e69f491da5bd3 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:29.164345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:29.164782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:29.240120 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f04e5-b602-446d-a559-64f2fab49a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:29.241386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f04e5-b602-446d-a559-64f2fab49a04 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:29.241834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f04e5-b602-446d-a559-64f2fab49a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:29.242264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f04e5-b602-446d-a559-64f2fab49a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:29.246350 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f86f04e5-b602-446d-a559-64f2fab49a04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:29.326314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97f219-0ed9-45b1-b201-486f622393ff admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:29.336609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048a93e-6b8b-4e81-a66e-e03beeb462c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:29.337304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048a93e-6b8b-4e81-a66e-e03beeb462c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:29.337545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048a93e-6b8b-4e81-a66e-e03beeb462c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:29.337772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048a93e-6b8b-4e81-a66e-e03beeb462c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:29.340667 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3048a93e-6b8b-4e81-a66e-e03beeb462c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:29.463180 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f04e5-b602-446d-a559-64f2fab49a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:29.465646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f04e5-b602-446d-a559-64f2fab49a04 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:29.513842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048a93e-6b8b-4e81-a66e-e03beeb462c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:29.515462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048a93e-6b8b-4e81-a66e-e03beeb462c6 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:29.527222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 904/1788] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:28 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:29.529810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f04e5-b602-446d-a559-64f2fab49a04 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:29.537844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f86f04e5-b602-446d-a559-64f2fab49a04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:29.539173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 885/1789] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:29.719580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f04e5-b602-446d-a559-64f2fab49a04 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:29.764538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:29.765654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:29.766144 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:29.766723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] PATH_INFO: `/v3/users/e721539bed2546f094e05f8f20503672` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:29.769683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e721539bed2546f094e05f8f20503672)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:29.775318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:30.127994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e721539bed2546f094e05f8f20503672'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:30.136792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e721539bed2546f094e05f8f20503672'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:30.319410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e721539bed2546f094e05f8f20503672'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:30.320446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e721539bed2546f094e05f8f20503672'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:30.321246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5cc0c777-daae-4ddc-90eb-278516362d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e721539bed2546f094e05f8f20503672'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:30.357833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 905/1790] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:29 2022] DELETE /identity/v3/users/e721539bed2546f094e05f8f20503672 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:30.803686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048a93e-6b8b-4e81-a66e-e03beeb462c6 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:30.805263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3048a93e-6b8b-4e81-a66e-e03beeb462c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:30.839206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048a93e-6b8b-4e81-a66e-e03beeb462c6 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:30.942950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:30.943575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:30.943910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:30.944290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] PATH_INFO: `/v3/users/18ac365708214d0689be268d5969355c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:30.945583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ac365708214d0689be268d5969355c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:30.949917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:31.100062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:31.161722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ac365708214d0689be268d5969355c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:31.162891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ac365708214d0689be268d5969355c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:31.187939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:31.251743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ac365708214d0689be268d5969355c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:31.268113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ac365708214d0689be268d5969355c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:31.284136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ac365708214d0689be268d5969355c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:31.299707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 886/1791] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:30 2022] DELETE /identity/v3/users/18ac365708214d0689be268d5969355c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:31.301143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eb317-eaf3-4e84-a8d4-db533b23ff30 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:31.301695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eb317-eaf3-4e84-a8d4-db533b23ff30 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:31.302068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eb317-eaf3-4e84-a8d4-db533b23ff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:31.328963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-395eb317-eaf3-4e84-a8d4-db533b23ff30 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:31.330041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-395eb317-eaf3-4e84-a8d4-db533b23ff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:31.362277 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:31.363803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:31.427786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 906/1792] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:31.437466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395eb317-eaf3-4e84-a8d4-db533b23ff30 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:31.448990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-395eb317-eaf3-4e84-a8d4-db533b23ff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:31.478051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2f14b-1571-466f-95d8-c9728bf9ffef admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:31.484016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:31.484757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:31.485316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:31.485528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] PATH_INFO: `/v3/projects/50483ab81b154a21a2c84d5e2a48d832` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:31.486823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50483ab81b154a21a2c84d5e2a48d832)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:31.488869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:31.535022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395eb317-eaf3-4e84-a8d4-db533b23ff30 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:31.538671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc3657-c5eb-430b-9de5-4cd0fcbf603e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:31.539315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc3657-c5eb-430b-9de5-4cd0fcbf603e service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:31.539596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc3657-c5eb-430b-9de5-4cd0fcbf603e service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:31.539876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc3657-c5eb-430b-9de5-4cd0fcbf603e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:31.551520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc3657-c5eb-430b-9de5-4cd0fcbf603e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:31.552976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc3657-c5eb-430b-9de5-4cd0fcbf603e service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:31.567872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 907/1793] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:31.636720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50483ab81b154a21a2c84d5e2a48d832', 'request_id': 'req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:31.643333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50483ab81b154a21a2c84d5e2a48d832', 'request_id': 'req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:31.701622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50483ab81b154a21a2c84d5e2a48d832', 'request_id': 'req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:31.716070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] The token cache is being invalidate because project 50483ab81b154a21a2c84d5e2a48d832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:31.716457 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:31.717804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-389d895c-5313-4ef1-91e6-d8bfb57f4cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:31.719393 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 887/1794] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:31 2022] DELETE /identity/v3/projects/50483ab81b154a21a2c84d5e2a48d832 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:31.724325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c7bfc-c42f-489a-95f2-d95d508430f2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:31.724679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c7bfc-c42f-489a-95f2-d95d508430f2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:31.724918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c7bfc-c42f-489a-95f2-d95d508430f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:31.749098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-138c7bfc-c42f-489a-95f2-d95d508430f2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:31.750554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-138c7bfc-c42f-489a-95f2-d95d508430f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:31.872553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 908/1795] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:31.881939 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99d6b2-1ccd-4abb-86a1-26325230a6e9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:31.882514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99d6b2-1ccd-4abb-86a1-26325230a6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:31.882613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99d6b2-1ccd-4abb-86a1-26325230a6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:31.907779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4e99d6b2-1ccd-4abb-86a1-26325230a6e9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:31.909071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4e99d6b2-1ccd-4abb-86a1-26325230a6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:31.918311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 888/1796] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:31.922688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c7bfc-c42f-489a-95f2-d95d508430f2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:31.934378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c7bfc-c42f-489a-95f2-d95d508430f2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:31.940097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720782-a936-4949-88d5-f4f3ee72b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:31.940738 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720782-a936-4949-88d5-f4f3ee72b50b admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:31.941018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720782-a936-4949-88d5-f4f3ee72b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:31.941337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720782-a936-4949-88d5-f4f3ee72b50b admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:31.942050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa720782-a936-4949-88d5-f4f3ee72b50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:31.942355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa720782-a936-4949-88d5-f4f3ee72b50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:31.944014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa720782-a936-4949-88d5-f4f3ee72b50b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:31.961216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 909/1797] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:31.962271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99d6b2-1ccd-4abb-86a1-26325230a6e9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:31.972837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99d6b2-1ccd-4abb-86a1-26325230a6e9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:31.977660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae74a8-3988-4720-a78a-817558a736f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:31.978338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae74a8-3988-4720-a78a-817558a736f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:31.979253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae74a8-3988-4720-a78a-817558a736f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:31.979539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae74a8-3988-4720-a78a-817558a736f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:31.980406 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae74a8-3988-4720-a78a-817558a736f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:31.982377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae74a8-3988-4720-a78a-817558a736f3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:32.006149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720782-a936-4949-88d5-f4f3ee72b50b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:32.007964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fa720782-a936-4949-88d5-f4f3ee72b50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:32.024917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720782-a936-4949-88d5-f4f3ee72b50b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:32.033642 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:32.034419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:32.034790 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:32.035123 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] PATH_INFO: `/v3/projects/6cc77d7da9dc477cbd5f1c439701ff63` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:32.036355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc77d7da9dc477cbd5f1c439701ff63)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:32.038527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:32.113562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 889/1798] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:31 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:32.114897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae74a8-3988-4720-a78a-817558a736f3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:32.160215 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc77d7da9dc477cbd5f1c439701ff63', 'request_id': 'req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:32.168265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc77d7da9dc477cbd5f1c439701ff63', 'request_id': 'req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:32.175360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc77d7da9dc477cbd5f1c439701ff63', 'request_id': 'req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:32.186699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae74a8-3988-4720-a78a-817558a736f3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:32.244652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bac90-7cdf-448b-8db2-666d19c26dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:32.248381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bac90-7cdf-448b-8db2-666d19c26dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:32.248381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bac90-7cdf-448b-8db2-666d19c26dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:32.248381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bac90-7cdf-448b-8db2-666d19c26dfd admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:32.248381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bac90-7cdf-448b-8db2-666d19c26dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:32.248755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bac90-7cdf-448b-8db2-666d19c26dfd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:32.273374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] The token cache is being invalidate because project 6cc77d7da9dc477cbd5f1c439701ff63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:32.273940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:32.274585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:32.277438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 910/1799] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:32 2022] DELETE /identity/v3/projects/6cc77d7da9dc477cbd5f1c439701ff63 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:32.280488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:32.282183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:32.296768 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbcbc4-dc82-45d4-9fb1-48300aa53fc5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:32.313314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:32.313314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:32.313314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:32.313314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] PATH_INFO: `/v3/users/be0b6a55549e4d6d8b0ab0cfab27871a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:32.313680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0b6a55549e4d6d8b0ab0cfab27871a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:32.313680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:32.343779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:32.349329 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 890/1800] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:32 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:32.353407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bac90-7cdf-448b-8db2-666d19c26dfd admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:32.355237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ef4bac90-7cdf-448b-8db2-666d19c26dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:32.367680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bac90-7cdf-448b-8db2-666d19c26dfd admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:32.373704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e0b95-954f-4808-96f0-dec8ee20b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:32.374452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e0b95-954f-4808-96f0-dec8ee20b4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:32.374715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e0b95-954f-4808-96f0-dec8ee20b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:32.374997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e0b95-954f-4808-96f0-dec8ee20b4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:32.375724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e0b95-954f-4808-96f0-dec8ee20b4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:32.377412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e0b95-954f-4808-96f0-dec8ee20b4d0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:32.391927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 891/1801] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:32.393027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e0b95-954f-4808-96f0-dec8ee20b4d0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:32.403901 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e0b95-954f-4808-96f0-dec8ee20b4d0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:32.408673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a66d2b-b3c1-4cb3-adde-1cfd77f91c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:32.409420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a66d2b-b3c1-4cb3-adde-1cfd77f91c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:32.409702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a66d2b-b3c1-4cb3-adde-1cfd77f91c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:32.409974 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a66d2b-b3c1-4cb3-adde-1cfd77f91c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:32.410664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a66d2b-b3c1-4cb3-adde-1cfd77f91c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:32.412262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a66d2b-b3c1-4cb3-adde-1cfd77f91c81 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:32.424274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 892/1802] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:32.428267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a66d2b-b3c1-4cb3-adde-1cfd77f91c81 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:32.439126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a66d2b-b3c1-4cb3-adde-1cfd77f91c81 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:32.444344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9de17-70c1-4e6f-98be-2a9d34d84ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:32.445210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9de17-70c1-4e6f-98be-2a9d34d84ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:32.445378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9de17-70c1-4e6f-98be-2a9d34d84ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:32.445655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9de17-70c1-4e6f-98be-2a9d34d84ab7 admin admin] PATH_INFO: `/v3/projects/5fde5669d25b46c08ede44bf1b46bbfd/users/5309852b69294961b7c9fd474524044a/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:32.461201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9de17-70c1-4e6f-98be-2a9d34d84ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fde5669d25b46c08ede44bf1b46bbfd, user_id=5309852b69294961b7c9fd474524044a, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:32.464396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9de17-70c1-4e6f-98be-2a9d34d84ab7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:32.488848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0b6a55549e4d6d8b0ab0cfab27871a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:32.498400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0b6a55549e4d6d8b0ab0cfab27871a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:32.541907 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 893/1803] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:32 2022] PUT /identity/v3/projects/5fde5669d25b46c08ede44bf1b46bbfd/users/5309852b69294961b7c9fd474524044a/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:32.552405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648210af-bfba-4d9a-9d5a-8f3b878ac8e9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:32.552695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648210af-bfba-4d9a-9d5a-8f3b878ac8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:32.552973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648210af-bfba-4d9a-9d5a-8f3b878ac8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:32.563958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0b6a55549e4d6d8b0ab0cfab27871a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:32.564671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0b6a55549e4d6d8b0ab0cfab27871a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:32.565378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0b6a55549e4d6d8b0ab0cfab27871a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:32.581626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-648210af-bfba-4d9a-9d5a-8f3b878ac8e9 None None] MFA Rules not processed for user `5309852b69294961b7c9fd474524044a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:32.582839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-648210af-bfba-4d9a-9d5a-8f3b878ac8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:32.583473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 911/1804] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:32 2022] DELETE /identity/v3/users/be0b6a55549e4d6d8b0ab0cfab27871a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:32.657676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 894/1805] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:32.662388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:32.664132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:32.730674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90448dc1-b482-4296-a5b7-4f48a3d4ad78 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:32.735321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae7e7-86d5-4222-8076-74738ed5c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:32.735939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae7e7-86d5-4222-8076-74738ed5c5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:32.736235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae7e7-86d5-4222-8076-74738ed5c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:32.736493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae7e7-86d5-4222-8076-74738ed5c5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:32.737192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ae7e7-86d5-4222-8076-74738ed5c5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:32.739104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ae7e7-86d5-4222-8076-74738ed5c5c4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:32.869156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 912/1806] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:32 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:32.870474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648210af-bfba-4d9a-9d5a-8f3b878ac8e9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:32.887001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648210af-bfba-4d9a-9d5a-8f3b878ac8e9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:32.945262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacd22b-1f65-4a12-97d5-6a5dc7759ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:32.945954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacd22b-1f65-4a12-97d5-6a5dc7759ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:32.946236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacd22b-1f65-4a12-97d5-6a5dc7759ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:32.946513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacd22b-1f65-4a12-97d5-6a5dc7759ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:32.947194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacd22b-1f65-4a12-97d5-6a5dc7759ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:32.949157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacd22b-1f65-4a12-97d5-6a5dc7759ff7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.053687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 895/1807] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:32 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:33.053830 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae7e7-86d5-4222-8076-74738ed5c5c4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.055445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacd22b-1f65-4a12-97d5-6a5dc7759ff7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.055866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-565ae7e7-86d5-4222-8076-74738ed5c5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:33.066639 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacd22b-1f65-4a12-97d5-6a5dc7759ff7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.070006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae7e7-86d5-4222-8076-74738ed5c5c4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.072474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714290-907c-4e8d-b69b-2d67d8592276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.074310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714290-907c-4e8d-b69b-2d67d8592276 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.074819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.075502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.075785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.076065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] PATH_INFO: `/v3/projects/8913e41a7db7437ebe6398deeccfaac1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.076174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714290-907c-4e8d-b69b-2d67d8592276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.076840 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714290-907c-4e8d-b69b-2d67d8592276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.077821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da714290-907c-4e8d-b69b-2d67d8592276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.078021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8913e41a7db7437ebe6398deeccfaac1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.079937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.080312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da714290-907c-4e8d-b69b-2d67d8592276 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.095947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 896/1808] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:33.099022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714290-907c-4e8d-b69b-2d67d8592276 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.116127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714290-907c-4e8d-b69b-2d67d8592276 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.121991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8bf92-9f95-4d5d-a684-8eadd53fa8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.122812 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8bf92-9f95-4d5d-a684-8eadd53fa8d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.130066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8bf92-9f95-4d5d-a684-8eadd53fa8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.130066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8bf92-9f95-4d5d-a684-8eadd53fa8d1 admin admin] PATH_INFO: `/v3/projects/3c7d8f162bfa438f9947eb4cfae40638/users/c566f252646044bd9c9fcf2e9663e671/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.141971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8bf92-9f95-4d5d-a684-8eadd53fa8d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7d8f162bfa438f9947eb4cfae40638, user_id=c566f252646044bd9c9fcf2e9663e671, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.144906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8bf92-9f95-4d5d-a684-8eadd53fa8d1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.147610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:33.245611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 897/1809] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:33 2022] PUT /identity/v3/projects/3c7d8f162bfa438f9947eb4cfae40638/users/c566f252646044bd9c9fcf2e9663e671/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:33.246933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8bf92-9f95-4d5d-a684-8eadd53fa8d1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.251103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8913e41a7db7437ebe6398deeccfaac1', 'request_id': 'req-a562c5ea-92f8-4bc5-ac28-56157faca847'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:33.258206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8913e41a7db7437ebe6398deeccfaac1', 'request_id': 'req-a562c5ea-92f8-4bc5-ac28-56157faca847'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:33.265344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8913e41a7db7437ebe6398deeccfaac1', 'request_id': 'req-a562c5ea-92f8-4bc5-ac28-56157faca847'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:33.310469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8bf92-9f95-4d5d-a684-8eadd53fa8d1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.364534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] The token cache is being invalidate because project 8913e41a7db7437ebe6398deeccfaac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:33.374891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:33.375642 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a562c5ea-92f8-4bc5-ac28-56157faca847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:33.377494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 913/1810] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:33 2022] DELETE /identity/v3/projects/8913e41a7db7437ebe6398deeccfaac1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:33.380299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6986589-8c31-4619-a996-f6fb144d1685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.381089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6986589-8c31-4619-a996-f6fb144d1685 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.381407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6986589-8c31-4619-a996-f6fb144d1685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.381686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6986589-8c31-4619-a996-f6fb144d1685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.382389 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6986589-8c31-4619-a996-f6fb144d1685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.383068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4204d-46c4-4f82-aec2-2bee2c84bff4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.383527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4204d-46c4-4f82-aec2-2bee2c84bff4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.383979 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4204d-46c4-4f82-aec2-2bee2c84bff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.384087 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6986589-8c31-4619-a996-f6fb144d1685 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.397163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 898/1811] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:33.399722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6986589-8c31-4619-a996-f6fb144d1685 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.403068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c6986589-8c31-4619-a996-f6fb144d1685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:33.410019 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c7e4204d-46c4-4f82-aec2-2bee2c84bff4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:33.411551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c7e4204d-46c4-4f82-aec2-2bee2c84bff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:33.417932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6986589-8c31-4619-a996-f6fb144d1685 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.423226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 914/1812] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:33.423365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e4968-ac09-4ca5-8c3f-f759f2c8e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.423868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4968-ac09-4ca5-8c3f-f759f2c8e9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.425914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4968-ac09-4ca5-8c3f-f759f2c8e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.425914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4968-ac09-4ca5-8c3f-f759f2c8e9d2 admin admin] PATH_INFO: `/v3/projects/3c7d8f162bfa438f9947eb4cfae40638/users/c566f252646044bd9c9fcf2e9663e671/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.426849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e4968-ac09-4ca5-8c3f-f759f2c8e9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7d8f162bfa438f9947eb4cfae40638, user_id=c566f252646044bd9c9fcf2e9663e671, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.429568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e4968-ac09-4ca5-8c3f-f759f2c8e9d2 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.430752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f130b-daa6-4da9-a2cf-6adbe5967b58 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.431100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f130b-daa6-4da9-a2cf-6adbe5967b58 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.431475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f130b-daa6-4da9-a2cf-6adbe5967b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.443600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 899/1813] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:33 2022] PUT /identity/v3/projects/3c7d8f162bfa438f9947eb4cfae40638/users/c566f252646044bd9c9fcf2e9663e671/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:33.454389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f20f130b-daa6-4da9-a2cf-6adbe5967b58 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:33.455651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0894b-63a3-46b7-8a29-7c147314b869 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.455764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f20f130b-daa6-4da9-a2cf-6adbe5967b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:33.455926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0894b-63a3-46b7-8a29-7c147314b869 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.456194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0894b-63a3-46b7-8a29-7c147314b869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.488665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a0d0894b-63a3-46b7-8a29-7c147314b869 None None] MFA Rules not processed for user `c566f252646044bd9c9fcf2e9663e671`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:33.490143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0d0894b-63a3-46b7-8a29-7c147314b869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:33.538983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 915/1814] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:33.544096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f130b-daa6-4da9-a2cf-6adbe5967b58 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.567164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f130b-daa6-4da9-a2cf-6adbe5967b58 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.575396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:33.581968 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526d437-f510-4c75-ab4a-e5ceda98c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.582874 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d437-f510-4c75-ab4a-e5ceda98c0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.583337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d437-f510-4c75-ab4a-e5ceda98c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.583796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d437-f510-4c75-ab4a-e5ceda98c0d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.583963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 900/1815] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:33.584821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526d437-f510-4c75-ab4a-e5ceda98c0d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:33.585149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526d437-f510-4c75-ab4a-e5ceda98c0d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.587461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526d437-f510-4c75-ab4a-e5ceda98c0d1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.600993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 916/1816] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:33.602794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0894b-63a3-46b7-8a29-7c147314b869 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.605481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0d0894b-63a3-46b7-8a29-7c147314b869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:33.607976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526d437-f510-4c75-ab4a-e5ceda98c0d1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.618462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526d437-f510-4c75-ab4a-e5ceda98c0d1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.625060 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4cadd-a7ee-42a3-b07e-d12c45db33da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.625647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4cadd-a7ee-42a3-b07e-d12c45db33da admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.625924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4cadd-a7ee-42a3-b07e-d12c45db33da admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.626190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4cadd-a7ee-42a3-b07e-d12c45db33da admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.626861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4cadd-a7ee-42a3-b07e-d12c45db33da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.629312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4cadd-a7ee-42a3-b07e-d12c45db33da admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.677031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0894b-63a3-46b7-8a29-7c147314b869 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.680913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70695f66-77a5-4838-b45c-39631a19a0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.681654 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70695f66-77a5-4838-b45c-39631a19a0bc service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.682389 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70695f66-77a5-4838-b45c-39631a19a0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.682389 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70695f66-77a5-4838-b45c-39631a19a0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.691647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70695f66-77a5-4838-b45c-39631a19a0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.693138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70695f66-77a5-4838-b45c-39631a19a0bc service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.703221 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 901/1817] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:04:33.727323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 917/1818] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:33 2022] POST /identity/v3/projects => generated 405 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:33.732483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70695f66-77a5-4838-b45c-39631a19a0bc service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.743593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70695f66-77a5-4838-b45c-39631a19a0bc service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.799371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:33.806792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78994f-3b42-483f-a9b3-0601e8341c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.807422 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78994f-3b42-483f-a9b3-0601e8341c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.807704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78994f-3b42-483f-a9b3-0601e8341c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.807982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78994f-3b42-483f-a9b3-0601e8341c7c admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.808648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78994f-3b42-483f-a9b3-0601e8341c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.810660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78994f-3b42-483f-a9b3-0601e8341c7c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.814778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4cadd-a7ee-42a3-b07e-d12c45db33da admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.871554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4cadd-a7ee-42a3-b07e-d12c45db33da admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.875441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07cc2c-6cbb-4204-9103-d635c8e6d4ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.876027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07cc2c-6cbb-4204-9103-d635c8e6d4ca service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.876307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07cc2c-6cbb-4204-9103-d635c8e6d4ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.876589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07cc2c-6cbb-4204-9103-d635c8e6d4ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.878517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-dd07cc2c-6cbb-4204-9103-d635c8e6d4ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:33.894476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 902/1819] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:33 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:33.898294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78994f-3b42-483f-a9b3-0601e8341c7c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.911381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78994f-3b42-483f-a9b3-0601e8341c7c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.917854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b273b-8af8-4280-b609-a49089a841c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.922891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b273b-8af8-4280-b609-a49089a841c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.922891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b273b-8af8-4280-b609-a49089a841c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.922891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b273b-8af8-4280-b609-a49089a841c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.922891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b273b-8af8-4280-b609-a49089a841c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.922891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b273b-8af8-4280-b609-a49089a841c9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.932616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 903/1820] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:33.936422 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b273b-8af8-4280-b609-a49089a841c9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.946284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b273b-8af8-4280-b609-a49089a841c9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.946679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07cc2c-6cbb-4204-9103-d635c8e6d4ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.949291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07cc2c-6cbb-4204-9103-d635c8e6d4ca service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.951398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaaa85-99f2-4514-9141-08a68d2422c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.953490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaaa85-99f2-4514-9141-08a68d2422c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.953490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaaa85-99f2-4514-9141-08a68d2422c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.953490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaaa85-99f2-4514-9141-08a68d2422c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:33.953490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaaa85-99f2-4514-9141-08a68d2422c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:33.954818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaaa85-99f2-4514-9141-08a68d2422c1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:33.959235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 918/1821] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:04:33.966583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 904/1822] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:33.971906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07cc2c-6cbb-4204-9103-d635c8e6d4ca service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:33.982677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07cc2c-6cbb-4204-9103-d635c8e6d4ca service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:33.987472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02279c-7a17-4d5f-81a5-7cb996865bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:33.988133 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02279c-7a17-4d5f-81a5-7cb996865bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:33.988414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02279c-7a17-4d5f-81a5-7cb996865bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:33.988807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02279c-7a17-4d5f-81a5-7cb996865bb1 admin admin] PATH_INFO: `/v3/projects/4caa05d8c65448da8b39b7feac11373a/users/9c30587cb163449e9f205e15f9f24e05/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:34.005356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02279c-7a17-4d5f-81a5-7cb996865bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4caa05d8c65448da8b39b7feac11373a, user_id=9c30587cb163449e9f205e15f9f24e05, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:34.008049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02279c-7a17-4d5f-81a5-7cb996865bb1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:34.073937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 919/1823] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:33 2022] PUT /identity/v3/projects/4caa05d8c65448da8b39b7feac11373a/users/9c30587cb163449e9f205e15f9f24e05/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:34.079226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61a9bb-2ef0-47de-9255-573beff9657b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:34.079517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61a9bb-2ef0-47de-9255-573beff9657b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:34.079796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61a9bb-2ef0-47de-9255-573beff9657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:34.102757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8a61a9bb-2ef0-47de-9255-573beff9657b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:34.106371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8a61a9bb-2ef0-47de-9255-573beff9657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:34.164941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 905/1824] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:34.174845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02279c-7a17-4d5f-81a5-7cb996865bb1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:34.176668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5c02279c-7a17-4d5f-81a5-7cb996865bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:34.236777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02279c-7a17-4d5f-81a5-7cb996865bb1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:34.247704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43f2c-1735-4ebe-8d1c-dd747ffbb748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:34.248706 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43f2c-1735-4ebe-8d1c-dd747ffbb748 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:34.249048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43f2c-1735-4ebe-8d1c-dd747ffbb748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:34.249355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43f2c-1735-4ebe-8d1c-dd747ffbb748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:34.259967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43f2c-1735-4ebe-8d1c-dd747ffbb748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:34.264409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43f2c-1735-4ebe-8d1c-dd747ffbb748 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:34.274208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 920/1825] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:34.576392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:34.702013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:35.824118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab9a40-74fa-4ce1-9276-419193a29472 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:35.824589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab9a40-74fa-4ce1-9276-419193a29472 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:35.825097 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab9a40-74fa-4ce1-9276-419193a29472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:35.833902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:35.858192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-60ab9a40-74fa-4ce1-9276-419193a29472 None None] MFA Rules not processed for user `9c30587cb163449e9f205e15f9f24e05`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:35.859480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-60ab9a40-74fa-4ce1-9276-419193a29472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:35.943646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 906/1826] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:35.948932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43f2c-1735-4ebe-8d1c-dd747ffbb748 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:35.958969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43f2c-1735-4ebe-8d1c-dd747ffbb748 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:35.964384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45e4e9-21ef-4f8a-89c5-abb6b650e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:35.965022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45e4e9-21ef-4f8a-89c5-abb6b650e90d admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:35.965343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45e4e9-21ef-4f8a-89c5-abb6b650e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:35.965624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45e4e9-21ef-4f8a-89c5-abb6b650e90d admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:35.966299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45e4e9-21ef-4f8a-89c5-abb6b650e90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:35.968243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45e4e9-21ef-4f8a-89c5-abb6b650e90d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:36.040467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 921/1827] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:35 2022] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:36.044612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab9a40-74fa-4ce1-9276-419193a29472 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:36.055712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab9a40-74fa-4ce1-9276-419193a29472 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:36.115223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa560a4-ff87-418b-938e-4d9768eef66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:36.115848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa560a4-ff87-418b-938e-4d9768eef66f admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:36.116132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa560a4-ff87-418b-938e-4d9768eef66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:36.116411 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa560a4-ff87-418b-938e-4d9768eef66f admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:36.117150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa560a4-ff87-418b-938e-4d9768eef66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:36.119139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa560a4-ff87-418b-938e-4d9768eef66f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:36.202378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 907/1828] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:36 2022] POST /identity/v3/users => generated 309 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:36.204350 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45e4e9-21ef-4f8a-89c5-abb6b650e90d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:36.216724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45e4e9-21ef-4f8a-89c5-abb6b650e90d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:36.221973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a911c-6315-4cb9-85e7-238ed69c2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:36.222892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a911c-6315-4cb9-85e7-238ed69c2304 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:36.223173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a911c-6315-4cb9-85e7-238ed69c2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:36.223449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a911c-6315-4cb9-85e7-238ed69c2304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:36.224146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a911c-6315-4cb9-85e7-238ed69c2304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:36.225782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a911c-6315-4cb9-85e7-238ed69c2304 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:36.243653 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 922/1829] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:36.248284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa560a4-ff87-418b-938e-4d9768eef66f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:36.258356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa560a4-ff87-418b-938e-4d9768eef66f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:36.263013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:36.267505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b31d39-c6d0-4bd8-aeaf-cf767936d6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:36.267505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b31d39-c6d0-4bd8-aeaf-cf767936d6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:36.267505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b31d39-c6d0-4bd8-aeaf-cf767936d6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:36.267505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b31d39-c6d0-4bd8-aeaf-cf767936d6b5 admin admin] PATH_INFO: `/v3/projects/0a775c43e58849868f6f495d722620fe/users/d2d0c7a7115c40e4a8d7e97a1bdb8ec7/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:36.281614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b31d39-c6d0-4bd8-aeaf-cf767936d6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a775c43e58849868f6f495d722620fe, user_id=d2d0c7a7115c40e4a8d7e97a1bdb8ec7, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:36.284309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b31d39-c6d0-4bd8-aeaf-cf767936d6b5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:36.377496 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 908/1830] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:36 2022] PUT /identity/v3/projects/0a775c43e58849868f6f495d722620fe/users/d2d0c7a7115c40e4a8d7e97a1bdb8ec7/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:36.381656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a911c-6315-4cb9-85e7-238ed69c2304 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:36.392410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a911c-6315-4cb9-85e7-238ed69c2304 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:36.448572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39442bf2-ccec-4465-984f-b4145b77117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:36.449246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39442bf2-ccec-4465-984f-b4145b77117e admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:36.449532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39442bf2-ccec-4465-984f-b4145b77117e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:36.449829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39442bf2-ccec-4465-984f-b4145b77117e admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:36.450527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39442bf2-ccec-4465-984f-b4145b77117e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:36.452118 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39442bf2-ccec-4465-984f-b4145b77117e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:36.461833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 923/1831] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:36.466252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b31d39-c6d0-4bd8-aeaf-cf767936d6b5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:36.476625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b31d39-c6d0-4bd8-aeaf-cf767936d6b5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:36.482283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd300e5d-d5d3-4033-80a3-a52cf591c316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:36.482959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd300e5d-d5d3-4033-80a3-a52cf591c316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:36.483248 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd300e5d-d5d3-4033-80a3-a52cf591c316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:36.483553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd300e5d-d5d3-4033-80a3-a52cf591c316 admin admin] PATH_INFO: `/v3/projects/0a775c43e58849868f6f495d722620fe/users/d2d0c7a7115c40e4a8d7e97a1bdb8ec7/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:36.485558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd300e5d-d5d3-4033-80a3-a52cf591c316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a775c43e58849868f6f495d722620fe, user_id=d2d0c7a7115c40e4a8d7e97a1bdb8ec7, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:36.488203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd300e5d-d5d3-4033-80a3-a52cf591c316 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:36.499767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 909/1832] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:36 2022] PUT /identity/v3/projects/0a775c43e58849868f6f495d722620fe/users/d2d0c7a7115c40e4a8d7e97a1bdb8ec7/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:36.987927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:37.519253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:37.828382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:38.108735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c2076-cdf8-42cd-a9e0-d13569fed100 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:38.109388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c2076-cdf8-42cd-a9e0-d13569fed100 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:38.109388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c2076-cdf8-42cd-a9e0-d13569fed100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:38.120215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:38.140863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-422c2076-cdf8-42cd-a9e0-d13569fed100 None None] MFA Rules not processed for user `d2d0c7a7115c40e4a8d7e97a1bdb8ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:38.142143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-422c2076-cdf8-42cd-a9e0-d13569fed100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:38.216291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 924/1833] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:38.879185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:38.919708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:39.113242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:39.205734 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af55337-b334-41d3-aef3-76c8fb7effae None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:39.207315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af55337-b334-41d3-aef3-76c8fb7effae None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:39.207594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af55337-b334-41d3-aef3-76c8fb7effae None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:39.209219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 910/1834] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 23:04:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:04:39.240018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678e83f-ed29-416f-a0c3-3368d3b2a7ed None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:39.240544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678e83f-ed29-416f-a0c3-3368d3b2a7ed None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:39.240544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678e83f-ed29-416f-a0c3-3368d3b2a7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:39.261946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4678e83f-ed29-416f-a0c3-3368d3b2a7ed None None] MFA Rules not processed for user `0aa69689b82d4994beac3b698d40c37f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:39.263174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4678e83f-ed29-416f-a0c3-3368d3b2a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:39.307093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:39.337178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 925/1835] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 23:04:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:39.354694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af55337-b334-41d3-aef3-76c8fb7effae None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:39.356347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4af55337-b334-41d3-aef3-76c8fb7effae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:39.373815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af55337-b334-41d3-aef3-76c8fb7effae None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:39.379677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a3595-aa79-4f09-9110-b8618251a667 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:39.379677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3595-aa79-4f09-9110-b8618251a667 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:39.379979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3595-aa79-4f09-9110-b8618251a667 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:39.380218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3595-aa79-4f09-9110-b8618251a667 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:39.390424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a3595-aa79-4f09-9110-b8618251a667 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:39.392035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a3595-aa79-4f09-9110-b8618251a667 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:39.417054 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 911/1836] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:40.018593 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1fd28-5bfd-4f09-9da4-2c927c7d1498 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:40.018889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1fd28-5bfd-4f09-9da4-2c927c7d1498 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:40.019176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1fd28-5bfd-4f09-9da4-2c927c7d1498 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:40.020904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 926/1837] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 23:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:04:40.036961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756dc0-a1ed-45cb-8c78-d163029f1e30 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:40.037559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756dc0-a1ed-45cb-8c78-d163029f1e30 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:40.037882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756dc0-a1ed-45cb-8c78-d163029f1e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:40.069549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d4756dc0-a1ed-45cb-8c78-d163029f1e30 None None] MFA Rules not processed for user `0aa69689b82d4994beac3b698d40c37f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:40.071304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d4756dc0-a1ed-45cb-8c78-d163029f1e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:40.093355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 912/1838] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 23:04:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:40.110625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1fd28-5bfd-4f09-9da4-2c927c7d1498 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:40.125966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1fd28-5bfd-4f09-9da4-2c927c7d1498 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:40.131645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f4374-bd9d-4e20-a272-2b843ecdb0f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:40.132288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f4374-bd9d-4e20-a272-2b843ecdb0f2 service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:40.132537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f4374-bd9d-4e20-a272-2b843ecdb0f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:40.132814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f4374-bd9d-4e20-a272-2b843ecdb0f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:40.142535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f4374-bd9d-4e20-a272-2b843ecdb0f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:40.144130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f4374-bd9d-4e20-a272-2b843ecdb0f2 service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:40.158624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 927/1839] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:40.172728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4756dc0-a1ed-45cb-8c78-d163029f1e30 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:40.252690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4756dc0-a1ed-45cb-8c78-d163029f1e30 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:40.257662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:40.258311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:40.258590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:40.258866 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] PATH_INFO: `/v3/users/9c30587cb163449e9f205e15f9f24e05` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:40.260081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c30587cb163449e9f205e15f9f24e05)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:40.262460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:40.460088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c30587cb163449e9f205e15f9f24e05'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:40.464017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c30587cb163449e9f205e15f9f24e05'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:40.516111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f4374-bd9d-4e20-a272-2b843ecdb0f2 service placement] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:40.518091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-134f4374-bd9d-4e20-a272-2b843ecdb0f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:40.530599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c30587cb163449e9f205e15f9f24e05'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:40.548600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c30587cb163449e9f205e15f9f24e05'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:40.556420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c30587cb163449e9f205e15f9f24e05'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:40.567213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:40.568462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 913/1840] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:40 2022] DELETE /identity/v3/users/9c30587cb163449e9f205e15f9f24e05 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:40.607647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f4374-bd9d-4e20-a272-2b843ecdb0f2 service placement] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:40.666281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00defdf1-e488-4b6e-bbfd-d02f856d260f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:40.667608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defdf1-e488-4b6e-bbfd-d02f856d260f service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:40.667888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defdf1-e488-4b6e-bbfd-d02f856d260f service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:40.668149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defdf1-e488-4b6e-bbfd-d02f856d260f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:40.670066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-00defdf1-e488-4b6e-bbfd-d02f856d260f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:40.738426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00defdf1-e488-4b6e-bbfd-d02f856d260f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:40.739930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00defdf1-e488-4b6e-bbfd-d02f856d260f service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:40.751164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 928/1841] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:40.880358 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:40.881984 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:40.955223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:40.958939 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc7348-788b-4b4f-8125-f293dd066fff admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:40.963861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:40.964587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:40.964870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:40.965172 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] PATH_INFO: `/v3/projects/4caa05d8c65448da8b39b7feac11373a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:40.966348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4caa05d8c65448da8b39b7feac11373a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:40.968250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:41.116863 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4caa05d8c65448da8b39b7feac11373a', 'request_id': 'req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:41.125561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4caa05d8c65448da8b39b7feac11373a', 'request_id': 'req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:41.187136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4caa05d8c65448da8b39b7feac11373a', 'request_id': 'req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:41.205928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] The token cache is being invalidate because project 4caa05d8c65448da8b39b7feac11373a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:41.206369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:41.207322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:41.212133 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 914/1842] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:40 2022] DELETE /identity/v3/projects/4caa05d8c65448da8b39b7feac11373a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:41.214513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00defdf1-e488-4b6e-bbfd-d02f856d260f service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:41.228953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00defdf1-e488-4b6e-bbfd-d02f856d260f service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:41.321312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:41.321959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:41.322239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:41.322630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] PATH_INFO: `/v3/users/d2d0c7a7115c40e4a8d7e97a1bdb8ec7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:41.324412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d0c7a7115c40e4a8d7e97a1bdb8ec7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:41.326531 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:41.506158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:41.515992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d0c7a7115c40e4a8d7e97a1bdb8ec7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:41.537151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d0c7a7115c40e4a8d7e97a1bdb8ec7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:41.593691 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d0c7a7115c40e4a8d7e97a1bdb8ec7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:41.594346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d0c7a7115c40e4a8d7e97a1bdb8ec7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:41.594998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5bbbe005-52e2-41c2-aa4a-18326c9e58b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d0c7a7115c40e4a8d7e97a1bdb8ec7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:41.617041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 929/1843] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:41 2022] DELETE /identity/v3/users/d2d0c7a7115c40e4a8d7e97a1bdb8ec7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:42.196029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:42.197701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:42.210808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f23dd-52c7-4a48-9eff-87eeedcf4ae9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:42.277085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:42.277822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:42.278032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:42.278731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] PATH_INFO: `/v3/projects/0a775c43e58849868f6f495d722620fe` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:42.281183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a775c43e58849868f6f495d722620fe)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:42.283766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:42.420880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a775c43e58849868f6f495d722620fe', 'request_id': 'req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:42.429867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a775c43e58849868f6f495d722620fe', 'request_id': 'req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:42.507402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a775c43e58849868f6f495d722620fe', 'request_id': 'req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:42.520879 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] The token cache is being invalidate because project 0a775c43e58849868f6f495d722620fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:42.521209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:42.521880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:42.523929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 915/1844] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:42 2022] DELETE /identity/v3/projects/0a775c43e58849868f6f495d722620fe => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:42.529554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff0fc-a4f4-4ae6-8fdc-6ab68cbaa1fa None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:42.529845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff0fc-a4f4-4ae6-8fdc-6ab68cbaa1fa None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:42.530117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff0fc-a4f4-4ae6-8fdc-6ab68cbaa1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:42.554575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-813ff0fc-a4f4-4ae6-8fdc-6ab68cbaa1fa None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:42.555940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-813ff0fc-a4f4-4ae6-8fdc-6ab68cbaa1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:42.625835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:42.630500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:42.658245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 930/1845] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:42.658375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:42.665770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd77a85-6e15-485a-a474-43d7888ff1dd None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:42.667398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd77a85-6e15-485a-a474-43d7888ff1dd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:42.667534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd77a85-6e15-485a-a474-43d7888ff1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:42.690376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-bbd77a85-6e15-485a-a474-43d7888ff1dd None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:42.691363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bbd77a85-6e15-485a-a474-43d7888ff1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:42.703332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 931/1846] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:42.709398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd77a85-6e15-485a-a474-43d7888ff1dd None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:42.722159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd77a85-6e15-485a-a474-43d7888ff1dd None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:42.729977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316e920-06da-403b-820a-89eacbdef083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:42.733699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e920-06da-403b-820a-89eacbdef083 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:42.733699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e920-06da-403b-820a-89eacbdef083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:42.733699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e920-06da-403b-820a-89eacbdef083 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:42.733699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316e920-06da-403b-820a-89eacbdef083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:42.733699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316e920-06da-403b-820a-89eacbdef083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:42.735011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316e920-06da-403b-820a-89eacbdef083 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:42.772610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5a679-c3f9-4e5d-a54f-7b4e5f4021eb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:42.772971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 932/1847] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:42.773051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:42.773051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:42.773051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:42.773051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] PATH_INFO: `/v3/users/5309852b69294961b7c9fd474524044a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:42.773354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5309852b69294961b7c9fd474524044a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:42.773354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:42.774682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316e920-06da-403b-820a-89eacbdef083 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:42.790999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316e920-06da-403b-820a-89eacbdef083 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:42.801349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae9bec-1633-48d9-b10f-951297e37bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:42.812297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae9bec-1633-48d9-b10f-951297e37bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:42.817263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae9bec-1633-48d9-b10f-951297e37bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:42.817644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae9bec-1633-48d9-b10f-951297e37bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:42.818485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae9bec-1633-48d9-b10f-951297e37bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:42.825053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae9bec-1633-48d9-b10f-951297e37bf9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:42.961833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 933/1848] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:42 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:42.968518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae9bec-1633-48d9-b10f-951297e37bf9 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:42.984396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5309852b69294961b7c9fd474524044a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:42.985053 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5309852b69294961b7c9fd474524044a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:43.035149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae9bec-1633-48d9-b10f-951297e37bf9 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:43.040574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741babf-ad00-4da7-8f52-83815b382fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:43.041878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741babf-ad00-4da7-8f52-83815b382fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:43.042239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741babf-ad00-4da7-8f52-83815b382fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:43.043167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741babf-ad00-4da7-8f52-83815b382fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:43.043353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741babf-ad00-4da7-8f52-83815b382fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:43.046602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741babf-ad00-4da7-8f52-83815b382fd7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:43.057879 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5309852b69294961b7c9fd474524044a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:43.078118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5309852b69294961b7c9fd474524044a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:43.085434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-901573f7-dd31-4504-85a7-fffdd573f501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5309852b69294961b7c9fd474524044a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:43.092285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 916/1849] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:42 2022] DELETE /identity/v3/users/5309852b69294961b7c9fd474524044a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:43.096673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac1541-194f-4344-9f5c-a2d329f2c775 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:43.096992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac1541-194f-4344-9f5c-a2d329f2c775 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:43.097350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac1541-194f-4344-9f5c-a2d329f2c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:43.118663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f9ac1541-194f-4344-9f5c-a2d329f2c775 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:43.121076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f9ac1541-194f-4344-9f5c-a2d329f2c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:43.166561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 934/1850] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:42 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:43.171130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741babf-ad00-4da7-8f52-83815b382fd7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:43.173280 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a741babf-ad00-4da7-8f52-83815b382fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:43.186249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741babf-ad00-4da7-8f52-83815b382fd7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:43.187989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 917/1851] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:43.191141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ccca7-1631-4d98-abad-70d41b69aa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:43.191745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ccca7-1631-4d98-abad-70d41b69aa0a admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:43.192304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ccca7-1631-4d98-abad-70d41b69aa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:43.192304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ccca7-1631-4d98-abad-70d41b69aa0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:43.192982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ccca7-1631-4d98-abad-70d41b69aa0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:43.194630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ccca7-1631-4d98-abad-70d41b69aa0a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:43.196982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:43.200794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac1541-194f-4344-9f5c-a2d329f2c775 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:43.203140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f9ac1541-194f-4344-9f5c-a2d329f2c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:43.208038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 935/1852] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:43.217188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ccca7-1631-4d98-abad-70d41b69aa0a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:43.227643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ccca7-1631-4d98-abad-70d41b69aa0a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:43.240653 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85ebd6-aff2-4d89-a1de-250d54ce88da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:43.241537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85ebd6-aff2-4d89-a1de-250d54ce88da admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:43.241824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85ebd6-aff2-4d89-a1de-250d54ce88da admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:43.242269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85ebd6-aff2-4d89-a1de-250d54ce88da admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:43.243234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85ebd6-aff2-4d89-a1de-250d54ce88da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:43.245134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85ebd6-aff2-4d89-a1de-250d54ce88da admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:43.255892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:43.267859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 936/1853] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:43.269495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85ebd6-aff2-4d89-a1de-250d54ce88da admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:43.272365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac1541-194f-4344-9f5c-a2d329f2c775 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:43.276081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d876d-6b3b-4e27-9182-9efc1e1e83e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:43.276953 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d876d-6b3b-4e27-9182-9efc1e1e83e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:43.277271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d876d-6b3b-4e27-9182-9efc1e1e83e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:43.277557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d876d-6b3b-4e27-9182-9efc1e1e83e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:43.282421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85ebd6-aff2-4d89-a1de-250d54ce88da admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:43.287125 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb6b6e-734b-4ee2-9dd9-2ec20ad09f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:43.287266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d876d-6b3b-4e27-9182-9efc1e1e83e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:43.287859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb6b6e-734b-4ee2-9dd9-2ec20ad09f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:43.288107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb6b6e-734b-4ee2-9dd9-2ec20ad09f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:43.288381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb6b6e-734b-4ee2-9dd9-2ec20ad09f19 admin admin] PATH_INFO: `/v3/projects/4d69975678164324a085e4abc26f2b7a/users/d65c28beda01423fa348a86eacff0e99/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:43.294093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d876d-6b3b-4e27-9182-9efc1e1e83e0 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:43.298777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 918/1854] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:43.303149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb6b6e-734b-4ee2-9dd9-2ec20ad09f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d69975678164324a085e4abc26f2b7a, user_id=d65c28beda01423fa348a86eacff0e99, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:43.305936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb6b6e-734b-4ee2-9dd9-2ec20ad09f19 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:43.440250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 937/1855] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:43 2022] PUT /identity/v3/projects/4d69975678164324a085e4abc26f2b7a/users/d65c28beda01423fa348a86eacff0e99/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:43.452317 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03708490-8261-47f0-8d94-19cafe89da6f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:43.452604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03708490-8261-47f0-8d94-19cafe89da6f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:43.452885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03708490-8261-47f0-8d94-19cafe89da6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:43.482881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-03708490-8261-47f0-8d94-19cafe89da6f None None] MFA Rules not processed for user `d65c28beda01423fa348a86eacff0e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:43.484084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-03708490-8261-47f0-8d94-19cafe89da6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:43.558119 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 919/1856] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:43.562472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb6b6e-734b-4ee2-9dd9-2ec20ad09f19 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:43.639758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb6b6e-734b-4ee2-9dd9-2ec20ad09f19 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:43.644688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616790eb-9358-40d9-86ed-e1d5e3c44876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:43.645425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616790eb-9358-40d9-86ed-e1d5e3c44876 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:43.645776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616790eb-9358-40d9-86ed-e1d5e3c44876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:43.646059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616790eb-9358-40d9-86ed-e1d5e3c44876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:43.646740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616790eb-9358-40d9-86ed-e1d5e3c44876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:43.648821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616790eb-9358-40d9-86ed-e1d5e3c44876 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:43.743664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03708490-8261-47f0-8d94-19cafe89da6f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:43.746612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-03708490-8261-47f0-8d94-19cafe89da6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:43.768167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 938/1857] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:43 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:43.771864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616790eb-9358-40d9-86ed-e1d5e3c44876 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:43.773569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03708490-8261-47f0-8d94-19cafe89da6f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:43.909242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:43.909997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:43.910350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:43.910698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] PATH_INFO: `/v3/projects/5fde5669d25b46c08ede44bf1b46bbfd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:43.912071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fde5669d25b46c08ede44bf1b46bbfd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:43.914340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:43.948741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616790eb-9358-40d9-86ed-e1d5e3c44876 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:43.954492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec9e6-823b-42a9-9267-8978f3489343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:43.955257 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec9e6-823b-42a9-9267-8978f3489343 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:43.955547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec9e6-823b-42a9-9267-8978f3489343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:43.955822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec9e6-823b-42a9-9267-8978f3489343 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:43.956542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ec9e6-823b-42a9-9267-8978f3489343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:43.958588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ec9e6-823b-42a9-9267-8978f3489343 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:44.033834 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fde5669d25b46c08ede44bf1b46bbfd', 'request_id': 'req-ab64ecf5-a5e0-4349-8509-0c695763566f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:44.038013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 939/1858] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:43 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:44.042861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec9e6-823b-42a9-9267-8978f3489343 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:44.045925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fde5669d25b46c08ede44bf1b46bbfd', 'request_id': 'req-ab64ecf5-a5e0-4349-8509-0c695763566f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:44.075486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec9e6-823b-42a9-9267-8978f3489343 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:44.102669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fde5669d25b46c08ede44bf1b46bbfd', 'request_id': 'req-ab64ecf5-a5e0-4349-8509-0c695763566f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:44.125753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:44.138194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] The token cache is being invalidate because project 5fde5669d25b46c08ede44bf1b46bbfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:44.139580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:44.140681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:44.148613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 920/1859] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:43 2022] DELETE /identity/v3/projects/5fde5669d25b46c08ede44bf1b46bbfd => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:44.149799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:44.154008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:44.154359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:44.227310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6374b-1857-4872-be90-cdf791c5afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:44.228540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6374b-1857-4872-be90-cdf791c5afce admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:44.229068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6374b-1857-4872-be90-cdf791c5afce admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:44.229612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6374b-1857-4872-be90-cdf791c5afce admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:44.230725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6374b-1857-4872-be90-cdf791c5afce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:44.233310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6374b-1857-4872-be90-cdf791c5afce admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:44.250902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 940/1860] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:44.257099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6374b-1857-4872-be90-cdf791c5afce admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:44.259720 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f9d6374b-1857-4872-be90-cdf791c5afce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:44.267488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64ecf5-a5e0-4349-8509-0c695763566f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:44.273145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:44.273825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:44.274158 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:44.275124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] PATH_INFO: `/v3/users/c566f252646044bd9c9fcf2e9663e671` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:44.276967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c566f252646044bd9c9fcf2e9663e671)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:44.283105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6374b-1857-4872-be90-cdf791c5afce admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:44.289487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014db03b-2185-49cf-9de6-38d5b02bcc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:44.290234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:44.291613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014db03b-2185-49cf-9de6-38d5b02bcc42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:44.292423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014db03b-2185-49cf-9de6-38d5b02bcc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:44.292850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014db03b-2185-49cf-9de6-38d5b02bcc42 admin admin] PATH_INFO: `/v3/projects/70e0b7da1c3c4dbfa2f7791d304ed5e3/users/0400198801c1458f91b53a96768cd647/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:44.330529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014db03b-2185-49cf-9de6-38d5b02bcc42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e0b7da1c3c4dbfa2f7791d304ed5e3, user_id=0400198801c1458f91b53a96768cd647, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:44.330529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014db03b-2185-49cf-9de6-38d5b02bcc42 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:44.406058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 941/1861] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:44 2022] PUT /identity/v3/projects/70e0b7da1c3c4dbfa2f7791d304ed5e3/users/0400198801c1458f91b53a96768cd647/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:44.410290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014db03b-2185-49cf-9de6-38d5b02bcc42 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:44.498512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014db03b-2185-49cf-9de6-38d5b02bcc42 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:44.504880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883dcd1-993d-49ea-a528-b88c63f6eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:44.505650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883dcd1-993d-49ea-a528-b88c63f6eec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:44.505890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883dcd1-993d-49ea-a528-b88c63f6eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:44.506173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883dcd1-993d-49ea-a528-b88c63f6eec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:44.506895 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883dcd1-993d-49ea-a528-b88c63f6eec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:44.508545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883dcd1-993d-49ea-a528-b88c63f6eec4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:44.515149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c566f252646044bd9c9fcf2e9663e671'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:44.516300 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c566f252646044bd9c9fcf2e9663e671'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:44.521559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 942/1862] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:44.526203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883dcd1-993d-49ea-a528-b88c63f6eec4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:44.536502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883dcd1-993d-49ea-a528-b88c63f6eec4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:44.541845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205d59-04f1-48e2-9cc9-5a357957dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:44.542586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205d59-04f1-48e2-9cc9-5a357957dffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:44.542873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205d59-04f1-48e2-9cc9-5a357957dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:44.543205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205d59-04f1-48e2-9cc9-5a357957dffa admin admin] PATH_INFO: `/v3/projects/70e0b7da1c3c4dbfa2f7791d304ed5e3/users/0400198801c1458f91b53a96768cd647/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:44.545325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205d59-04f1-48e2-9cc9-5a357957dffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e0b7da1c3c4dbfa2f7791d304ed5e3, user_id=0400198801c1458f91b53a96768cd647, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:44.547918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205d59-04f1-48e2-9cc9-5a357957dffa admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:44.560512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 943/1863] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:44 2022] PUT /identity/v3/projects/70e0b7da1c3c4dbfa2f7791d304ed5e3/users/0400198801c1458f91b53a96768cd647/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:44.563947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c566f252646044bd9c9fcf2e9663e671'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:44.570821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daf8ca-df80-44d0-b3e8-06c4939a8aa6 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:44.571394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daf8ca-df80-44d0-b3e8-06c4939a8aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:44.571394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daf8ca-df80-44d0-b3e8-06c4939a8aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:44.583669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c566f252646044bd9c9fcf2e9663e671'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:44.593852 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c566f252646044bd9c9fcf2e9663e671'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:44.603956 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 921/1864] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:44 2022] DELETE /identity/v3/users/c566f252646044bd9c9fcf2e9663e671 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:44.608656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d2daf8ca-df80-44d0-b3e8-06c4939a8aa6 None None] MFA Rules not processed for user `0400198801c1458f91b53a96768cd647`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:44.609927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d2daf8ca-df80-44d0-b3e8-06c4939a8aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:44.718699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 944/1865] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:44.732810 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:44.734354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:44.836106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000238f-2168-4f70-ae13-33566ae5e1d8 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:44.848977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05f10-1eda-4b10-bf7c-f260c967545a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:44.850012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05f10-1eda-4b10-bf7c-f260c967545a service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:44.850473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05f10-1eda-4b10-bf7c-f260c967545a service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:44.850760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05f10-1eda-4b10-bf7c-f260c967545a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:44.868488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05f10-1eda-4b10-bf7c-f260c967545a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:44.868488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05f10-1eda-4b10-bf7c-f260c967545a service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:44.884169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 922/1866] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:45.334236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daf8ca-df80-44d0-b3e8-06c4939a8aa6 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:45.335768 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d2daf8ca-df80-44d0-b3e8-06c4939a8aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:45.366746 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:45.431501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daf8ca-df80-44d0-b3e8-06c4939a8aa6 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:45.436265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:45.436565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:45.436844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:45.438130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] PATH_INFO: `/v3/projects/3c7d8f162bfa438f9947eb4cfae40638` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:45.439673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7d8f162bfa438f9947eb4cfae40638)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:45.442845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:45.611181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7d8f162bfa438f9947eb4cfae40638', 'request_id': 'req-cb2b533a-be94-42ce-9018-b3e5dbc790f1'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:45.621442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7d8f162bfa438f9947eb4cfae40638', 'request_id': 'req-cb2b533a-be94-42ce-9018-b3e5dbc790f1'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:45.628072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7d8f162bfa438f9947eb4cfae40638', 'request_id': 'req-cb2b533a-be94-42ce-9018-b3e5dbc790f1'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:45.736499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] The token cache is being invalidate because project 3c7d8f162bfa438f9947eb4cfae40638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:45.736798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:45.739086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-cb2b533a-be94-42ce-9018-b3e5dbc790f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:45.741844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 945/1867] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:45 2022] DELETE /identity/v3/projects/3c7d8f162bfa438f9947eb4cfae40638 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:45.747226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92710d-5be5-409c-9a3a-5fa7b31ce5c5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:45.748110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92710d-5be5-409c-9a3a-5fa7b31ce5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:45.748539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92710d-5be5-409c-9a3a-5fa7b31ce5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:45.756833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c882-c096-4096-acae-3aeaa3751f88 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:45.757445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c882-c096-4096-acae-3aeaa3751f88 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:45.757870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c882-c096-4096-acae-3aeaa3751f88 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:45.759665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 946/1868] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 23:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:04:45.771188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9c92710d-5be5-409c-9a3a-5fa7b31ce5c5 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:45.773066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9c92710d-5be5-409c-9a3a-5fa7b31ce5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:45.774594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6198a-731b-4ff8-b469-d7a511c73617 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:45.774890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6198a-731b-4ff8-b469-d7a511c73617 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:45.775198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6198a-731b-4ff8-b469-d7a511c73617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:45.801150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:45.824303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ebf6198a-731b-4ff8-b469-d7a511c73617 None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:45.825604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ebf6198a-731b-4ff8-b469-d7a511c73617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:45.864452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 923/1869] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:45.877838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d904a6e-877d-4970-b3eb-20a98e4ca202 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:45.878219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d904a6e-877d-4970-b3eb-20a98e4ca202 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:45.878575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d904a6e-877d-4970-b3eb-20a98e4ca202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:45.920672 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3d904a6e-877d-4970-b3eb-20a98e4ca202 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:45.922063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3d904a6e-877d-4970-b3eb-20a98e4ca202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:45.945414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 924/1870] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:45.950102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d904a6e-877d-4970-b3eb-20a98e4ca202 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:45.962094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d904a6e-877d-4970-b3eb-20a98e4ca202 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:45.971133 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c74aa7-2add-4361-93a3-7b6894b9586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:45.971894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c74aa7-2add-4361-93a3-7b6894b9586e admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:45.972280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c74aa7-2add-4361-93a3-7b6894b9586e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:45.972704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c74aa7-2add-4361-93a3-7b6894b9586e admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:45.974131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c74aa7-2add-4361-93a3-7b6894b9586e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:45.974131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c74aa7-2add-4361-93a3-7b6894b9586e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:45.979235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c74aa7-2add-4361-93a3-7b6894b9586e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:45.979358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 947/1871] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 23:04:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:45.993663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 925/1872] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:45.998976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6198a-731b-4ff8-b469-d7a511c73617 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:46.014370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6198a-731b-4ff8-b469-d7a511c73617 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:46.021605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a5bd0-1140-481e-8b07-c8bddfa7aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:46.022458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a5bd0-1140-481e-8b07-c8bddfa7aa39 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.022885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a5bd0-1140-481e-8b07-c8bddfa7aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.023558 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a5bd0-1140-481e-8b07-c8bddfa7aa39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.025370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a5bd0-1140-481e-8b07-c8bddfa7aa39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:46.028595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a5bd0-1140-481e-8b07-c8bddfa7aa39 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:46.109152 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c74aa7-2add-4361-93a3-7b6894b9586e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:46.111248 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-40c74aa7-2add-4361-93a3-7b6894b9586e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:46.134143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c74aa7-2add-4361-93a3-7b6894b9586e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:46.140650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d09e2-a224-4021-88fc-9539fa187a7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:46.141502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d09e2-a224-4021-88fc-9539fa187a7e service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.141834 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d09e2-a224-4021-88fc-9539fa187a7e service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.142384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d09e2-a224-4021-88fc-9539fa187a7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.146896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 948/1873] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:45 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:46.147535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a5bd0-1140-481e-8b07-c8bddfa7aa39 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:46.155434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d09e2-a224-4021-88fc-9539fa187a7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:46.157167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d09e2-a224-4021-88fc-9539fa187a7e service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:46.170124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 926/1874] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:04:46.188615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:46.246340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a5bd0-1140-481e-8b07-c8bddfa7aa39 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:46.251461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b36310-8168-4ad4-8725-12bec5f549f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:46.252122 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b36310-8168-4ad4-8725-12bec5f549f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.252407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b36310-8168-4ad4-8725-12bec5f549f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.252696 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b36310-8168-4ad4-8725-12bec5f549f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.253408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b36310-8168-4ad4-8725-12bec5f549f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:46.255448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b36310-8168-4ad4-8725-12bec5f549f5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:46.285884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d09e2-a224-4021-88fc-9539fa187a7e service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:46.287317 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a43d09e2-a224-4021-88fc-9539fa187a7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:46.302627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d09e2-a224-4021-88fc-9539fa187a7e service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:46.318302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:46.319318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.319318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.319554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] PATH_INFO: `/v3/users/d65c28beda01423fa348a86eacff0e99` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.320824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65c28beda01423fa348a86eacff0e99)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:46.323076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:46.349985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 949/1875] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:46 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:46.356279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b36310-8168-4ad4-8725-12bec5f549f5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:46.370955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b36310-8168-4ad4-8725-12bec5f549f5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:46.376103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18f21e-8420-48ab-b662-2c2714a3ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:46.376735 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18f21e-8420-48ab-b662-2c2714a3ba9d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.377021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18f21e-8420-48ab-b662-2c2714a3ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.377332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18f21e-8420-48ab-b662-2c2714a3ba9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.378072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18f21e-8420-48ab-b662-2c2714a3ba9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:46.379689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18f21e-8420-48ab-b662-2c2714a3ba9d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:46.390074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 950/1876] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:46.393962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18f21e-8420-48ab-b662-2c2714a3ba9d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:46.405160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18f21e-8420-48ab-b662-2c2714a3ba9d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:46.410601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b0a63-cec5-459b-9796-7c11d5c9b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:46.411254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b0a63-cec5-459b-9796-7c11d5c9b9ea admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.411556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b0a63-cec5-459b-9796-7c11d5c9b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.411848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b0a63-cec5-459b-9796-7c11d5c9b9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.412527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b0a63-cec5-459b-9796-7c11d5c9b9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:46.414244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b0a63-cec5-459b-9796-7c11d5c9b9ea admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:46.426403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 951/1877] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:46.430600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b0a63-cec5-459b-9796-7c11d5c9b9ea admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:46.441199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b0a63-cec5-459b-9796-7c11d5c9b9ea admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:46.446184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61da322-fc53-4fee-941b-07278216c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:46.446864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61da322-fc53-4fee-941b-07278216c234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.447148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61da322-fc53-4fee-941b-07278216c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.447615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61da322-fc53-4fee-941b-07278216c234 admin admin] PATH_INFO: `/v3/projects/6e5a33a693e8430c9e64675f871c2f6c/users/8b36de6b78d1404b8bc8e9188a59a834/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.464492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61da322-fc53-4fee-941b-07278216c234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5a33a693e8430c9e64675f871c2f6c, user_id=8b36de6b78d1404b8bc8e9188a59a834, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:46.467553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61da322-fc53-4fee-941b-07278216c234 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:46.602043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 952/1878] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:46 2022] PUT /identity/v3/projects/6e5a33a693e8430c9e64675f871c2f6c/users/8b36de6b78d1404b8bc8e9188a59a834/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:46.608256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3270a0-89d5-4256-a5ef-c2e1a4aa7d8f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.608423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3270a0-89d5-4256-a5ef-c2e1a4aa7d8f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.608734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3270a0-89d5-4256-a5ef-c2e1a4aa7d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.621800 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65c28beda01423fa348a86eacff0e99'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:46.622763 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65c28beda01423fa348a86eacff0e99'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:46.633728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ce3270a0-89d5-4256-a5ef-c2e1a4aa7d8f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:46.636331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ce3270a0-89d5-4256-a5ef-c2e1a4aa7d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:46.716221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 953/1879] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:46.727203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3270a0-89d5-4256-a5ef-c2e1a4aa7d8f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:46.729226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ce3270a0-89d5-4256-a5ef-c2e1a4aa7d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:46.764348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65c28beda01423fa348a86eacff0e99'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:46.784378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65c28beda01423fa348a86eacff0e99'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:46.794776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3a96d58c-1433-44b4-884c-3bfe928bbdb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65c28beda01423fa348a86eacff0e99'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:46.804832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 927/1880] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:46 2022] DELETE /identity/v3/users/d65c28beda01423fa348a86eacff0e99 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:46.807427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3270a0-89d5-4256-a5ef-c2e1a4aa7d8f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:46.809738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90871cee-6699-4c59-a322-e3badec55db0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.810761 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90871cee-6699-4c59-a322-e3badec55db0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.811215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90871cee-6699-4c59-a322-e3badec55db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.826163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:46.837463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-90871cee-6699-4c59-a322-e3badec55db0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:46.839734 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-90871cee-6699-4c59-a322-e3badec55db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:46.887945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a0c89-7999-4ef7-a3ed-bb5a97f1f310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:46.889951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a0c89-7999-4ef7-a3ed-bb5a97f1f310 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.890396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a0c89-7999-4ef7-a3ed-bb5a97f1f310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.891069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a0c89-7999-4ef7-a3ed-bb5a97f1f310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.894477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5a4a0c89-7999-4ef7-a3ed-bb5a97f1f310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:46.941400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 928/1881] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:46.951681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90871cee-6699-4c59-a322-e3badec55db0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:46.953028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-90871cee-6699-4c59-a322-e3badec55db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:46.960093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:46.967614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90871cee-6699-4c59-a322-e3badec55db0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:46.971311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460ecb4-01aa-46f8-896b-cc0266c97579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:46.974613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460ecb4-01aa-46f8-896b-cc0266c97579 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:46.974730 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a0c89-7999-4ef7-a3ed-bb5a97f1f310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:46.974824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460ecb4-01aa-46f8-896b-cc0266c97579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:46.974824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460ecb4-01aa-46f8-896b-cc0266c97579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:46.974993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a0c89-7999-4ef7-a3ed-bb5a97f1f310 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:46.982263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460ecb4-01aa-46f8-896b-cc0266c97579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:46.983735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460ecb4-01aa-46f8-896b-cc0266c97579 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:46.984168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 954/1882] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:04:46.996979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 929/1883] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:04:47.529104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a0c89-7999-4ef7-a3ed-bb5a97f1f310 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:47.530557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5a4a0c89-7999-4ef7-a3ed-bb5a97f1f310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:47.545682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a0c89-7999-4ef7-a3ed-bb5a97f1f310 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:47.550567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:47.551349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:47.551651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:47.551917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] PATH_INFO: `/v3/projects/4d69975678164324a085e4abc26f2b7a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:47.553163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d69975678164324a085e4abc26f2b7a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:47.555254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:47.697143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d69975678164324a085e4abc26f2b7a', 'request_id': 'req-fc110bf2-64fb-4493-a600-e426a62af1ca'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:47.706978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d69975678164324a085e4abc26f2b7a', 'request_id': 'req-fc110bf2-64fb-4493-a600-e426a62af1ca'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:47.716890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d69975678164324a085e4abc26f2b7a', 'request_id': 'req-fc110bf2-64fb-4493-a600-e426a62af1ca'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:47.804080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] The token cache is being invalidate because project 4d69975678164324a085e4abc26f2b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:47.804370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:47.805017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:47.806605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 955/1884] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:47 2022] DELETE /identity/v3/projects/4d69975678164324a085e4abc26f2b7a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:47.811379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460ecb4-01aa-46f8-896b-cc0266c97579 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:47.822001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460ecb4-01aa-46f8-896b-cc0266c97579 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:47.918660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:47.919401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:47.919685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:47.919959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] PATH_INFO: `/v3/users/0400198801c1458f91b53a96768cd647` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:47.921242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0400198801c1458f91b53a96768cd647)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:47.923399 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:48.180356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0400198801c1458f91b53a96768cd647'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:48.181219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0400198801c1458f91b53a96768cd647'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:48.267633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0400198801c1458f91b53a96768cd647'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:48.281952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0400198801c1458f91b53a96768cd647'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:48.289409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9befe6f3-cfa1-4874-9c36-cc28e6ca21c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0400198801c1458f91b53a96768cd647'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:48.296390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 930/1885] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:47 2022] DELETE /identity/v3/users/0400198801c1458f91b53a96768cd647 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:48.823525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:48.827473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:48.846390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc110bf2-64fb-4493-a600-e426a62af1ca admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:48.904252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:48.914222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:48.914877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:48.915158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:48.916547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] PATH_INFO: `/v3/projects/70e0b7da1c3c4dbfa2f7791d304ed5e3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:48.916747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e0b7da1c3c4dbfa2f7791d304ed5e3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:48.918926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.058709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e0b7da1c3c4dbfa2f7791d304ed5e3', 'request_id': 'req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:49.065204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e0b7da1c3c4dbfa2f7791d304ed5e3', 'request_id': 'req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:49.070791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e0b7da1c3c4dbfa2f7791d304ed5e3', 'request_id': 'req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:49.130625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bec49-ca20-41e2-90bf-830f9187f6d9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.131098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bec49-ca20-41e2-90bf-830f9187f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.131189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bec49-ca20-41e2-90bf-830f9187f6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.153620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] The token cache is being invalidate because project 70e0b7da1c3c4dbfa2f7791d304ed5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:49.157520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:49.157520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f463ba2-b9f5-4be4-8e71-1c6f8a3657e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:49.160274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 956/1886] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:48 2022] DELETE /identity/v3/projects/70e0b7da1c3c4dbfa2f7791d304ed5e3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:49.164984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdfc60-ce2d-4c6b-9694-4cdca751f262 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.165312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdfc60-ce2d-4c6b-9694-4cdca751f262 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.165620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdfc60-ce2d-4c6b-9694-4cdca751f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.188825 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6dbdfc60-ce2d-4c6b-9694-4cdca751f262 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:49.190213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6dbdfc60-ce2d-4c6b-9694-4cdca751f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:49.199661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-da9bec49-ca20-41e2-90bf-830f9187f6d9 None None] MFA Rules not processed for user `8b36de6b78d1404b8bc8e9188a59a834`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:49.200999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-da9bec49-ca20-41e2-90bf-830f9187f6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:49.305253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:49.307609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 957/1887] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:49.319411 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 931/1888] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:49.319636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1d7f7-b47e-4167-94ef-b3b18f2e1305 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.319636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1d7f7-b47e-4167-94ef-b3b18f2e1305 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.319636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1d7f7-b47e-4167-94ef-b3b18f2e1305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.321286 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bec49-ca20-41e2-90bf-830f9187f6d9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.323987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-da9bec49-ca20-41e2-90bf-830f9187f6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:49.346674 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bec49-ca20-41e2-90bf-830f9187f6d9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.352263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-16f1d7f7-b47e-4167-94ef-b3b18f2e1305 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:49.353786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-16f1d7f7-b47e-4167-94ef-b3b18f2e1305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:49.355802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf4d54-7d07-46f7-b565-a1ce8884354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.356958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf4d54-7d07-46f7-b565-a1ce8884354c admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.357423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf4d54-7d07-46f7-b565-a1ce8884354c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.357877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf4d54-7d07-46f7-b565-a1ce8884354c admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.359329 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf4d54-7d07-46f7-b565-a1ce8884354c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.361379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf4d54-7d07-46f7-b565-a1ce8884354c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.366799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 958/1889] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:49.370099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1d7f7-b47e-4167-94ef-b3b18f2e1305 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.381462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1d7f7-b47e-4167-94ef-b3b18f2e1305 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.387665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da99f-b2ff-452d-b7fa-1a74943a6bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.388405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da99f-b2ff-452d-b7fa-1a74943a6bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.388759 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da99f-b2ff-452d-b7fa-1a74943a6bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.389038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da99f-b2ff-452d-b7fa-1a74943a6bb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.389867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da99f-b2ff-452d-b7fa-1a74943a6bb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:49.390287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da99f-b2ff-452d-b7fa-1a74943a6bb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.391908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da99f-b2ff-452d-b7fa-1a74943a6bb3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.406690 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 959/1890] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:49.411386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da99f-b2ff-452d-b7fa-1a74943a6bb3 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.422287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da99f-b2ff-452d-b7fa-1a74943a6bb3 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.427839 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9ae91-8925-4b39-8a67-903f485ff433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.428598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9ae91-8925-4b39-8a67-903f485ff433 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.428882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9ae91-8925-4b39-8a67-903f485ff433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.429218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9ae91-8925-4b39-8a67-903f485ff433 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.430010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9ae91-8925-4b39-8a67-903f485ff433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.433007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9ae91-8925-4b39-8a67-903f485ff433 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.469378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 932/1891] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:49 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:49.473803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf4d54-7d07-46f7-b565-a1ce8884354c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.547017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 960/1892] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:49 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:49.551383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9ae91-8925-4b39-8a67-903f485ff433 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.555110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf4d54-7d07-46f7-b565-a1ce8884354c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.612659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6288db-5b94-43c2-bf56-004c5cd489df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.613330 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6288db-5b94-43c2-bf56-004c5cd489df admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.613638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6288db-5b94-43c2-bf56-004c5cd489df admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.613913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6288db-5b94-43c2-bf56-004c5cd489df admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.614615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6288db-5b94-43c2-bf56-004c5cd489df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.616535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9ae91-8925-4b39-8a67-903f485ff433 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.616646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6288db-5b94-43c2-bf56-004c5cd489df admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.621596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5e22-8131-4458-8077-ce649ef5a74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.622221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5e22-8131-4458-8077-ce649ef5a74e admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.622509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5e22-8131-4458-8077-ce649ef5a74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.622777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5e22-8131-4458-8077-ce649ef5a74e admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.623447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f5e22-8131-4458-8077-ce649ef5a74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.625385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f5e22-8131-4458-8077-ce649ef5a74e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.753044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 933/1893] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:49 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:49.753425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 961/1894] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:49 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:49.756969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6288db-5b94-43c2-bf56-004c5cd489df admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.763417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5e22-8131-4458-8077-ce649ef5a74e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.771638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6288db-5b94-43c2-bf56-004c5cd489df admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.777364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ad6ec-6a02-4446-a82c-82da0b97aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.778241 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ad6ec-6a02-4446-a82c-82da0b97aa19 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.778526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ad6ec-6a02-4446-a82c-82da0b97aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.778806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ad6ec-6a02-4446-a82c-82da0b97aa19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.779512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ad6ec-6a02-4446-a82c-82da0b97aa19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.780131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5e22-8131-4458-8077-ce649ef5a74e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.781282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ad6ec-6a02-4446-a82c-82da0b97aa19 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.786234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30c18b-a19e-41e8-b331-a8cac8b75d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.786986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30c18b-a19e-41e8-b331-a8cac8b75d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.787264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30c18b-a19e-41e8-b331-a8cac8b75d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.787540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30c18b-a19e-41e8-b331-a8cac8b75d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.788273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30c18b-a19e-41e8-b331-a8cac8b75d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.789950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30c18b-a19e-41e8-b331-a8cac8b75d65 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.794858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 934/1895] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:49.796878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ad6ec-6a02-4446-a82c-82da0b97aa19 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.805018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 962/1896] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:49.806948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30c18b-a19e-41e8-b331-a8cac8b75d65 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.808109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ad6ec-6a02-4446-a82c-82da0b97aa19 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.813888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff367f-afde-4edc-bff0-1846241d7731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.814893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff367f-afde-4edc-bff0-1846241d7731 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.815253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff367f-afde-4edc-bff0-1846241d7731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.815602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff367f-afde-4edc-bff0-1846241d7731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.816563 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff367f-afde-4edc-bff0-1846241d7731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.818274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff367f-afde-4edc-bff0-1846241d7731 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.820199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30c18b-a19e-41e8-b331-a8cac8b75d65 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.826059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2597245-1572-4917-99ae-b2260217fd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.826863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2597245-1572-4917-99ae-b2260217fd6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.827174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2597245-1572-4917-99ae-b2260217fd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.827446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2597245-1572-4917-99ae-b2260217fd6a admin admin] PATH_INFO: `/v3/projects/435250827333420f9884d5414ba9ca45/users/b16e1b13f1ac408eb1448b7207f2432b/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.831541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 935/1897] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:49.835650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff367f-afde-4edc-bff0-1846241d7731 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.846673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2597245-1572-4917-99ae-b2260217fd6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=435250827333420f9884d5414ba9ca45, user_id=b16e1b13f1ac408eb1448b7207f2432b, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.852166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2597245-1572-4917-99ae-b2260217fd6a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.852340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff367f-afde-4edc-bff0-1846241d7731 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.860766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c672a6-61f9-4d7a-94a5-e5ad5e2dcb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.861680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c672a6-61f9-4d7a-94a5-e5ad5e2dcb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.862135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c672a6-61f9-4d7a-94a5-e5ad5e2dcb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.862478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c672a6-61f9-4d7a-94a5-e5ad5e2dcb1f admin admin] PATH_INFO: `/v3/projects/87acad5d8c2241dabd57c464e0064420/users/daa7742bc71c4eecb22e1dfdcc5dc7d3/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.878535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c672a6-61f9-4d7a-94a5-e5ad5e2dcb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87acad5d8c2241dabd57c464e0064420, user_id=daa7742bc71c4eecb22e1dfdcc5dc7d3, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.881450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c672a6-61f9-4d7a-94a5-e5ad5e2dcb1f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.941387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:49.950643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 963/1898] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:49 2022] PUT /identity/v3/projects/435250827333420f9884d5414ba9ca45/users/b16e1b13f1ac408eb1448b7207f2432b/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:49.955851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2597245-1572-4917-99ae-b2260217fd6a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.984368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 936/1899] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:49 2022] PUT /identity/v3/projects/87acad5d8c2241dabd57c464e0064420/users/daa7742bc71c4eecb22e1dfdcc5dc7d3/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:50.004085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688573e2-6471-4b84-8e4a-9c9900b08988 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:50.004655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688573e2-6471-4b84-8e4a-9c9900b08988 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:50.005104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688573e2-6471-4b84-8e4a-9c9900b08988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:50.074993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2597245-1572-4917-99ae-b2260217fd6a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:50.087271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-688573e2-6471-4b84-8e4a-9c9900b08988 None None] MFA Rules not processed for user `daa7742bc71c4eecb22e1dfdcc5dc7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:50.089585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-688573e2-6471-4b84-8e4a-9c9900b08988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:50.119422 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:50.189219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 937/1900] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:50.198700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688573e2-6471-4b84-8e4a-9c9900b08988 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:50.199680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7b1c1-ad77-4e82-9594-a8e74b15d008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:50.200942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7b1c1-ad77-4e82-9594-a8e74b15d008 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:50.201577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7b1c1-ad77-4e82-9594-a8e74b15d008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:50.202067 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7b1c1-ad77-4e82-9594-a8e74b15d008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:50.203597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7b1c1-ad77-4e82-9594-a8e74b15d008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:50.208569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7b1c1-ad77-4e82-9594-a8e74b15d008 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:50.211933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688573e2-6471-4b84-8e4a-9c9900b08988 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:50.218253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50948227-21c1-4d55-97f6-311a0dac044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:50.219074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50948227-21c1-4d55-97f6-311a0dac044c admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:50.219527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50948227-21c1-4d55-97f6-311a0dac044c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:50.219964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50948227-21c1-4d55-97f6-311a0dac044c admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:50.220814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50948227-21c1-4d55-97f6-311a0dac044c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:50.223038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50948227-21c1-4d55-97f6-311a0dac044c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:50.232306 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 964/1901] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:04:50.237146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7b1c1-ad77-4e82-9594-a8e74b15d008 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:50.248310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7b1c1-ad77-4e82-9594-a8e74b15d008 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:50.253259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990d9d-d61b-4e82-b8c3-63a73c566b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:50.254088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990d9d-d61b-4e82-b8c3-63a73c566b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:50.254372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990d9d-d61b-4e82-b8c3-63a73c566b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:50.254647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990d9d-d61b-4e82-b8c3-63a73c566b75 admin admin] PATH_INFO: `/v3/projects/435250827333420f9884d5414ba9ca45/users/b16e1b13f1ac408eb1448b7207f2432b/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:50.256662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34990d9d-d61b-4e82-b8c3-63a73c566b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435250827333420f9884d5414ba9ca45, user_id=b16e1b13f1ac408eb1448b7207f2432b, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:50.259380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34990d9d-d61b-4e82-b8c3-63a73c566b75 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:50.270911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 965/1902] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:50 2022] PUT /identity/v3/projects/435250827333420f9884d5414ba9ca45/users/b16e1b13f1ac408eb1448b7207f2432b/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:50.323229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 938/1903] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:50 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:50.331135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990d9d-d61b-4e82-b8c3-63a73c566b75 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:50.402639 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990d9d-d61b-4e82-b8c3-63a73c566b75 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:50.482001 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03500bd5-d4d4-49f9-95e7-461fc6a5d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:50.483048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03500bd5-d4d4-49f9-95e7-461fc6a5d18a admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:50.483048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03500bd5-d4d4-49f9-95e7-461fc6a5d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:50.483322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03500bd5-d4d4-49f9-95e7-461fc6a5d18a admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:50.483974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03500bd5-d4d4-49f9-95e7-461fc6a5d18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:50.486027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03500bd5-d4d4-49f9-95e7-461fc6a5d18a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:50.524510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:50.548784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 966/1904] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:50 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:50.552772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50948227-21c1-4d55-97f6-311a0dac044c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:50.576401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50948227-21c1-4d55-97f6-311a0dac044c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:50.581513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98534928-5701-4944-9d20-b892430e5356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:50.582149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98534928-5701-4944-9d20-b892430e5356 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:50.582427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98534928-5701-4944-9d20-b892430e5356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:50.582918 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98534928-5701-4944-9d20-b892430e5356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:50.583448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98534928-5701-4944-9d20-b892430e5356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:50.585179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98534928-5701-4944-9d20-b892430e5356 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:50.598335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 939/1905] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:50.604728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03500bd5-d4d4-49f9-95e7-461fc6a5d18a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:50.620549 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03500bd5-d4d4-49f9-95e7-461fc6a5d18a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:50.635985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c191410-3e32-4f59-ba2e-f2224d4e6451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:50.636797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191410-3e32-4f59-ba2e-f2224d4e6451 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:50.637066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191410-3e32-4f59-ba2e-f2224d4e6451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:50.637372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191410-3e32-4f59-ba2e-f2224d4e6451 admin admin] PATH_INFO: `/v3/projects/cebd29db072c43b1b116b0c05e96aaac/users/d14b301ad36644f8a40affe010f684bd/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:50.658819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c191410-3e32-4f59-ba2e-f2224d4e6451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebd29db072c43b1b116b0c05e96aaac, user_id=d14b301ad36644f8a40affe010f684bd, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:50.661689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c191410-3e32-4f59-ba2e-f2224d4e6451 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:50.737411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 967/1906] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:50 2022] PUT /identity/v3/projects/cebd29db072c43b1b116b0c05e96aaac/users/d14b301ad36644f8a40affe010f684bd/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:04:50.741397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98534928-5701-4944-9d20-b892430e5356 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:50.752647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98534928-5701-4944-9d20-b892430e5356 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:50.835409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da44e6-5fc6-4f2e-b33a-1608538b7408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:50.836177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da44e6-5fc6-4f2e-b33a-1608538b7408 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:50.836466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da44e6-5fc6-4f2e-b33a-1608538b7408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:50.836760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da44e6-5fc6-4f2e-b33a-1608538b7408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:50.837489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da44e6-5fc6-4f2e-b33a-1608538b7408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:50.839451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da44e6-5fc6-4f2e-b33a-1608538b7408 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:50.851191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 940/1907] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:50.858749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c191410-3e32-4f59-ba2e-f2224d4e6451 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:50.871365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c191410-3e32-4f59-ba2e-f2224d4e6451 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:50.876480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb679741-730f-4fe4-8e27-00fc54f5e014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:50.877213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb679741-730f-4fe4-8e27-00fc54f5e014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:50.877496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb679741-730f-4fe4-8e27-00fc54f5e014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:50.877773 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb679741-730f-4fe4-8e27-00fc54f5e014 admin admin] PATH_INFO: `/v3/projects/cebd29db072c43b1b116b0c05e96aaac/users/d14b301ad36644f8a40affe010f684bd/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:50.879813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb679741-730f-4fe4-8e27-00fc54f5e014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebd29db072c43b1b116b0c05e96aaac, user_id=d14b301ad36644f8a40affe010f684bd, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:50.883243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb679741-730f-4fe4-8e27-00fc54f5e014 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:50.895814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 968/1908] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:50 2022] PUT /identity/v3/projects/cebd29db072c43b1b116b0c05e96aaac/users/d14b301ad36644f8a40affe010f684bd/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:50.913372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189510d-609e-44f5-b6b3-6d2aeedff1ee None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:50.913659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189510d-609e-44f5-b6b3-6d2aeedff1ee None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:50.913940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189510d-609e-44f5-b6b3-6d2aeedff1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:50.944040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9189510d-609e-44f5-b6b3-6d2aeedff1ee None None] MFA Rules not processed for user `d14b301ad36644f8a40affe010f684bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:50.945332 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9189510d-609e-44f5-b6b3-6d2aeedff1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:51.017006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 941/1909] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:51.028969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb679741-730f-4fe4-8e27-00fc54f5e014 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:51.030905 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bb679741-730f-4fe4-8e27-00fc54f5e014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:51.097003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb679741-730f-4fe4-8e27-00fc54f5e014 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:51.100897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758f8aa-d57b-44f9-bd70-07c58ca81e04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:51.101569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758f8aa-d57b-44f9-bd70-07c58ca81e04 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:51.101848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758f8aa-d57b-44f9-bd70-07c58ca81e04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:51.102157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758f8aa-d57b-44f9-bd70-07c58ca81e04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:51.114304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758f8aa-d57b-44f9-bd70-07c58ca81e04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:51.115802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758f8aa-d57b-44f9-bd70-07c58ca81e04 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:51.128929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 969/1910] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:51.850933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58cb1e-fdba-4359-ac42-8e155e8eb8e0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:51.851481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58cb1e-fdba-4359-ac42-8e155e8eb8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:51.851481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58cb1e-fdba-4359-ac42-8e155e8eb8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:51.865612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:51.911426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2e58cb1e-fdba-4359-ac42-8e155e8eb8e0 None None] MFA Rules not processed for user `b16e1b13f1ac408eb1448b7207f2432b`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:51.913145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2e58cb1e-fdba-4359-ac42-8e155e8eb8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:52.013311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 942/1911] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:52.024820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758f8aa-d57b-44f9-bd70-07c58ca81e04 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:52.034298 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758f8aa-d57b-44f9-bd70-07c58ca81e04 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:52.050782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7549cc-b7b9-46ec-82fd-244e4a470d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:52.050782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7549cc-b7b9-46ec-82fd-244e4a470d3e service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:52.050782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7549cc-b7b9-46ec-82fd-244e4a470d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:52.050782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7549cc-b7b9-46ec-82fd-244e4a470d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:52.086043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:52.121612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7549cc-b7b9-46ec-82fd-244e4a470d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:52.123076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7549cc-b7b9-46ec-82fd-244e4a470d3e service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:52.132376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 970/1912] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:53.497472 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58cb1e-fdba-4359-ac42-8e155e8eb8e0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:53.573424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58cb1e-fdba-4359-ac42-8e155e8eb8e0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:53.578065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:53.578784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:53.579163 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:53.579541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] PATH_INFO: `/v3/users/daa7742bc71c4eecb22e1dfdcc5dc7d3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:53.580805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa7742bc71c4eecb22e1dfdcc5dc7d3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:53.583001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:53.747766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa7742bc71c4eecb22e1dfdcc5dc7d3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:53.748559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa7742bc71c4eecb22e1dfdcc5dc7d3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:53.803736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa7742bc71c4eecb22e1dfdcc5dc7d3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:53.817386 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa7742bc71c4eecb22e1dfdcc5dc7d3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:53.829862 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa7742bc71c4eecb22e1dfdcc5dc7d3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:53.836807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 943/1913] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:53 2022] DELETE /identity/v3/users/daa7742bc71c4eecb22e1dfdcc5dc7d3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:53.842585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fa213-f6bb-4b90-b358-6dc538b90eaf None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:53.843063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fa213-f6bb-4b90-b358-6dc538b90eaf None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:53.843138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fa213-f6bb-4b90-b358-6dc538b90eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:53.867345 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3c9fa213-f6bb-4b90-b358-6dc538b90eaf None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:53.868712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3c9fa213-f6bb-4b90-b358-6dc538b90eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:53.955891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 971/1914] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:53.969896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:53.971604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:53.983951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:54.033843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfe079-464b-4c42-9d87-1ba3b82760a0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:54.037778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d77d7-4642-46b1-8e33-c5f0796e7018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:54.044704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d77d7-4642-46b1-8e33-c5f0796e7018 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:54.044704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d77d7-4642-46b1-8e33-c5f0796e7018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:54.044704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d77d7-4642-46b1-8e33-c5f0796e7018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:54.049828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d77d7-4642-46b1-8e33-c5f0796e7018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:54.051268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d77d7-4642-46b1-8e33-c5f0796e7018 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:54.062192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 944/1915] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:54.469853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fa213-f6bb-4b90-b358-6dc538b90eaf None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:54.471341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3c9fa213-f6bb-4b90-b358-6dc538b90eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:54.484413 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fa213-f6bb-4b90-b358-6dc538b90eaf None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:54.490216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:54.490875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:54.491187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:54.491435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] PATH_INFO: `/v3/projects/87acad5d8c2241dabd57c464e0064420` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:54.492628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=87acad5d8c2241dabd57c464e0064420)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:54.494688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:54.651933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87acad5d8c2241dabd57c464e0064420', 'request_id': 'req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:54.658846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87acad5d8c2241dabd57c464e0064420', 'request_id': 'req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:54.665284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87acad5d8c2241dabd57c464e0064420', 'request_id': 'req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:54.746598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] The token cache is being invalidate because project 87acad5d8c2241dabd57c464e0064420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:54.746891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:54.747517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:54.749103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 972/1916] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:54 2022] DELETE /identity/v3/projects/87acad5d8c2241dabd57c464e0064420 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:54.753080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d77d7-4642-46b1-8e33-c5f0796e7018 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:54.762870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d77d7-4642-46b1-8e33-c5f0796e7018 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:54.819807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:54.820444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:54.820724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:54.821000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] PATH_INFO: `/v3/users/d14b301ad36644f8a40affe010f684bd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:54.822227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14b301ad36644f8a40affe010f684bd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:54.824153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:55.036045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14b301ad36644f8a40affe010f684bd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:55.036705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14b301ad36644f8a40affe010f684bd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:55.090085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14b301ad36644f8a40affe010f684bd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:55.103710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14b301ad36644f8a40affe010f684bd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:55.120930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c7585d98-8816-48f1-9ed8-58ae649ef9cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14b301ad36644f8a40affe010f684bd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:55.127223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 945/1917] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:04:54 2022] DELETE /identity/v3/users/d14b301ad36644f8a40affe010f684bd => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:55.560824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:55.562279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:55.577001 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30e88a-1bd4-4386-afe0-8e3fa3bf76bd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:55.627247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:55.639540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:55.640191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:55.640471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:55.640746 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] PATH_INFO: `/v3/projects/cebd29db072c43b1b116b0c05e96aaac` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:55.641963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cebd29db072c43b1b116b0c05e96aaac)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:55.643861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:55.763041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cebd29db072c43b1b116b0c05e96aaac', 'request_id': 'req-3b0d392d-cea5-4747-8961-b294dfb3abe4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:55.770352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cebd29db072c43b1b116b0c05e96aaac', 'request_id': 'req-3b0d392d-cea5-4747-8961-b294dfb3abe4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:55.777153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cebd29db072c43b1b116b0c05e96aaac', 'request_id': 'req-3b0d392d-cea5-4747-8961-b294dfb3abe4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:55.897539 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] The token cache is being invalidate because project cebd29db072c43b1b116b0c05e96aaac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:04:55.897837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:55.898506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3b0d392d-cea5-4747-8961-b294dfb3abe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:04:55.900296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 973/1918] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:04:55 2022] DELETE /identity/v3/projects/cebd29db072c43b1b116b0c05e96aaac => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:55.906476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2d8e-2c1b-492a-a509-6f7e36cce725 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:55.906999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2d8e-2c1b-492a-a509-6f7e36cce725 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:55.909515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2d8e-2c1b-492a-a509-6f7e36cce725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:55.928237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-efee2d8e-2c1b-492a-a509-6f7e36cce725 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:55.929494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-efee2d8e-2c1b-492a-a509-6f7e36cce725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:55.956737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:55.990535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 946/1919] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:55.999360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7779a-e14a-44e3-841b-1a3f0ac082ff None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:55.999653 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7779a-e14a-44e3-841b-1a3f0ac082ff None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:55.999937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7779a-e14a-44e3-841b-1a3f0ac082ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:56.019554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9fa7779a-e14a-44e3-841b-1a3f0ac082ff None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:56.020764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9fa7779a-e14a-44e3-841b-1a3f0ac082ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:56.029528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 974/1920] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:56.033967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2d8e-2c1b-492a-a509-6f7e36cce725 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:56.044848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2d8e-2c1b-492a-a509-6f7e36cce725 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:56.049567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe172f7-5775-4490-8934-d645d8c8ca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:56.050189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe172f7-5775-4490-8934-d645d8c8ca43 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:56.050470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe172f7-5775-4490-8934-d645d8c8ca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:56.050748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe172f7-5775-4490-8934-d645d8c8ca43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:56.051444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe172f7-5775-4490-8934-d645d8c8ca43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:56.051749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe172f7-5775-4490-8934-d645d8c8ca43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:56.053395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe172f7-5775-4490-8934-d645d8c8ca43 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:56.066158 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 947/1921] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:56.070231 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7779a-e14a-44e3-841b-1a3f0ac082ff None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:56.079939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7779a-e14a-44e3-841b-1a3f0ac082ff None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:56.084640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9aa1-3205-408e-ac4e-47b41e255c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:56.085294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9aa1-3205-408e-ac4e-47b41e255c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:56.085576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9aa1-3205-408e-ac4e-47b41e255c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:56.085852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9aa1-3205-408e-ac4e-47b41e255c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:56.086513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a9aa1-3205-408e-ac4e-47b41e255c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:56.088990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a9aa1-3205-408e-ac4e-47b41e255c33 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:56.189362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 975/1922] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:04:56 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:04:56.193588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe172f7-5775-4490-8934-d645d8c8ca43 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:56.204284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe172f7-5775-4490-8934-d645d8c8ca43 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:56.271543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5e973-42c7-47cd-8d5a-7697156f5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:56.272165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5e973-42c7-47cd-8d5a-7697156f5210 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:56.272442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5e973-42c7-47cd-8d5a-7697156f5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:56.272715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5e973-42c7-47cd-8d5a-7697156f5210 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:56.273434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5e973-42c7-47cd-8d5a-7697156f5210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:56.276339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5e973-42c7-47cd-8d5a-7697156f5210 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:56.361645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 948/1923] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:04:56 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:04:56.366545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9aa1-3205-408e-ac4e-47b41e255c33 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:56.377328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9aa1-3205-408e-ac4e-47b41e255c33 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:56.382643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694096d6-3fda-4092-9a16-c63c59f32b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:56.383369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694096d6-3fda-4092-9a16-c63c59f32b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:56.383648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694096d6-3fda-4092-9a16-c63c59f32b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:56.384057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694096d6-3fda-4092-9a16-c63c59f32b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:56.390490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694096d6-3fda-4092-9a16-c63c59f32b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:56.390490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694096d6-3fda-4092-9a16-c63c59f32b42 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:56.399399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 976/1924] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:56.404351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5e973-42c7-47cd-8d5a-7697156f5210 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:56.414944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5e973-42c7-47cd-8d5a-7697156f5210 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:56.419948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e89f5a-b8f3-4b35-b1d1-ac6891d7daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:56.420580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89f5a-b8f3-4b35-b1d1-ac6891d7daff admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:56.420851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89f5a-b8f3-4b35-b1d1-ac6891d7daff admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:56.421142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89f5a-b8f3-4b35-b1d1-ac6891d7daff admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:56.421855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e89f5a-b8f3-4b35-b1d1-ac6891d7daff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:56.423462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e89f5a-b8f3-4b35-b1d1-ac6891d7daff admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:56.434890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 949/1925] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:04:56.439147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694096d6-3fda-4092-9a16-c63c59f32b42 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:56.450506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694096d6-3fda-4092-9a16-c63c59f32b42 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:56.455177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2d2ec-76cb-4066-ba5a-4a890a2eda81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:56.455865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2d2ec-76cb-4066-ba5a-4a890a2eda81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:56.459276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2d2ec-76cb-4066-ba5a-4a890a2eda81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:56.459276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2d2ec-76cb-4066-ba5a-4a890a2eda81 admin admin] PATH_INFO: `/v3/projects/843c7d380def40ce979e96ce24b69550/users/aa5bc97b9a5047d092810883d17c7582/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:56.472342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2d2ec-76cb-4066-ba5a-4a890a2eda81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843c7d380def40ce979e96ce24b69550, user_id=aa5bc97b9a5047d092810883d17c7582, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:56.475067 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2d2ec-76cb-4066-ba5a-4a890a2eda81 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:56.524278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 977/1926] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:04:56 2022] PUT /identity/v3/projects/843c7d380def40ce979e96ce24b69550/users/aa5bc97b9a5047d092810883d17c7582/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:04:56.536459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d95c06-6373-44b4-a7a8-52c456244572 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:56.536743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d95c06-6373-44b4-a7a8-52c456244572 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:56.537021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d95c06-6373-44b4-a7a8-52c456244572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:56.567636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-12d95c06-6373-44b4-a7a8-52c456244572 None None] MFA Rules not processed for user `aa5bc97b9a5047d092810883d17c7582`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:56.568982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-12d95c06-6373-44b4-a7a8-52c456244572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:56.639010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 950/1927] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:04:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:56.650976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2d2ec-76cb-4066-ba5a-4a890a2eda81 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:56.652709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5fa2d2ec-76cb-4066-ba5a-4a890a2eda81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:56.712202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2d2ec-76cb-4066-ba5a-4a890a2eda81 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:56.716661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ded982-dce2-467c-912c-2ef517b351cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:56.717320 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ded982-dce2-467c-912c-2ef517b351cd service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:56.717608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ded982-dce2-467c-912c-2ef517b351cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:56.717887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ded982-dce2-467c-912c-2ef517b351cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:56.726369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ded982-dce2-467c-912c-2ef517b351cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:56.727808 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ded982-dce2-467c-912c-2ef517b351cd service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:56.736705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 978/1928] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:57.481382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d95c06-6373-44b4-a7a8-52c456244572 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:57.491433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d95c06-6373-44b4-a7a8-52c456244572 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:57.495877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ad448-25ad-48bf-aa93-4e813f3ed7eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:57.505676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad448-25ad-48bf-aa93-4e813f3ed7eb service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:57.505676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad448-25ad-48bf-aa93-4e813f3ed7eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:57.505676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad448-25ad-48bf-aa93-4e813f3ed7eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:57.505676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-892ad448-25ad-48bf-aa93-4e813f3ed7eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:57.537245 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:57.577665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ad448-25ad-48bf-aa93-4e813f3ed7eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:57.579118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ad448-25ad-48bf-aa93-4e813f3ed7eb service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:57.590663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 951/1929] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:02.674043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ded982-dce2-467c-912c-2ef517b351cd service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:02.694033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:02.744249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ded982-dce2-467c-912c-2ef517b351cd service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:02.752526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:02.753534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:02.753817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:02.754128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] PATH_INFO: `/v3/users/aa5bc97b9a5047d092810883d17c7582` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:02.756022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5bc97b9a5047d092810883d17c7582)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:02.758329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:03.052474 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5bc97b9a5047d092810883d17c7582'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:03.061016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5bc97b9a5047d092810883d17c7582'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:03.158753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5bc97b9a5047d092810883d17c7582'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:03.161511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5bc97b9a5047d092810883d17c7582'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:03.161511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5bc97b9a5047d092810883d17c7582'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:03.192894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 979/1930] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:02 2022] DELETE /identity/v3/users/aa5bc97b9a5047d092810883d17c7582 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:03.197507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debee20-b08e-4d07-9ea6-44adda478e21 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:03.198254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debee20-b08e-4d07-9ea6-44adda478e21 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:03.198254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debee20-b08e-4d07-9ea6-44adda478e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:03.216774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5debee20-b08e-4d07-9ea6-44adda478e21 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:03.218021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5debee20-b08e-4d07-9ea6-44adda478e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:03.282974 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 952/1931] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:03.296718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:03.298188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:03.373008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a545f8-0337-42ac-9490-cfc62d87cb94 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:03.382507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c272d7-8b84-45a3-9667-2b3830866452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:03.382507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c272d7-8b84-45a3-9667-2b3830866452 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:03.382507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c272d7-8b84-45a3-9667-2b3830866452 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:03.382507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c272d7-8b84-45a3-9667-2b3830866452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:03.394298 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c272d7-8b84-45a3-9667-2b3830866452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:03.396114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c272d7-8b84-45a3-9667-2b3830866452 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:03.411920 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 980/1932] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:04.044013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debee20-b08e-4d07-9ea6-44adda478e21 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:04.046792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5debee20-b08e-4d07-9ea6-44adda478e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:04.073803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debee20-b08e-4d07-9ea6-44adda478e21 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:04.079208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:04.080008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.080353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.080695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] PATH_INFO: `/v3/projects/843c7d380def40ce979e96ce24b69550` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.081981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843c7d380def40ce979e96ce24b69550)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:04.083986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:04.192882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843c7d380def40ce979e96ce24b69550', 'request_id': 'req-9513acf2-f3b5-487f-b92c-a197b3c076f9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:04.200939 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843c7d380def40ce979e96ce24b69550', 'request_id': 'req-9513acf2-f3b5-487f-b92c-a197b3c076f9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:04.295602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843c7d380def40ce979e96ce24b69550', 'request_id': 'req-9513acf2-f3b5-487f-b92c-a197b3c076f9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:04.313416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] The token cache is being invalidate because project 843c7d380def40ce979e96ce24b69550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:04.314104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:04.315118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9513acf2-f3b5-487f-b92c-a197b3c076f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:04.317400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 953/1933] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:04 2022] DELETE /identity/v3/projects/843c7d380def40ce979e96ce24b69550 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:04.322174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cec6dc-a64f-47f2-a5d6-fad9638524f1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.326710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cec6dc-a64f-47f2-a5d6-fad9638524f1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.326710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cec6dc-a64f-47f2-a5d6-fad9638524f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.350140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d0cec6dc-a64f-47f2-a5d6-fad9638524f1 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:04.352146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d0cec6dc-a64f-47f2-a5d6-fad9638524f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:04.403941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:04.455783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 981/1934] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:04.462807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d670e-d99a-4e97-b04b-f13535ef3b68 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.463867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d670e-d99a-4e97-b04b-f13535ef3b68 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.464342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d670e-d99a-4e97-b04b-f13535ef3b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.487038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-211d670e-d99a-4e97-b04b-f13535ef3b68 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:04.488411 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-211d670e-d99a-4e97-b04b-f13535ef3b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:04.499528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 954/1935] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:04.504289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cec6dc-a64f-47f2-a5d6-fad9638524f1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:04.516595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cec6dc-a64f-47f2-a5d6-fad9638524f1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:04.521592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df458d-075e-4ea8-a44e-8cb0d24bbb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:04.522236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df458d-075e-4ea8-a44e-8cb0d24bbb0e admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.522696 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df458d-075e-4ea8-a44e-8cb0d24bbb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.522987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df458d-075e-4ea8-a44e-8cb0d24bbb0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.523731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df458d-075e-4ea8-a44e-8cb0d24bbb0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:04.524034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df458d-075e-4ea8-a44e-8cb0d24bbb0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:04.526319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df458d-075e-4ea8-a44e-8cb0d24bbb0e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:04.544143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 982/1936] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:04.547519 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d670e-d99a-4e97-b04b-f13535ef3b68 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:04.557915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d670e-d99a-4e97-b04b-f13535ef3b68 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:04.562642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd5e97-11e5-4f0f-81e2-28719df406e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:04.563289 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5e97-11e5-4f0f-81e2-28719df406e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.563568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5e97-11e5-4f0f-81e2-28719df406e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.563857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5e97-11e5-4f0f-81e2-28719df406e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.564706 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd5e97-11e5-4f0f-81e2-28719df406e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:04.566759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd5e97-11e5-4f0f-81e2-28719df406e2 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:04.701005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 955/1937] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:04 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:04.704903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df458d-075e-4ea8-a44e-8cb0d24bbb0e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:04.725507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df458d-075e-4ea8-a44e-8cb0d24bbb0e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:04.845710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2b138-2a31-44c4-893b-8b0585660298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:04.846556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2b138-2a31-44c4-893b-8b0585660298 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.846903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2b138-2a31-44c4-893b-8b0585660298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.847244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2b138-2a31-44c4-893b-8b0585660298 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.848585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2b138-2a31-44c4-893b-8b0585660298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:04.851554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2b138-2a31-44c4-893b-8b0585660298 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:04.973229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd5e97-11e5-4f0f-81e2-28719df406e2 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:04.973434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 983/1938] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:04 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:04.987985 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd5e97-11e5-4f0f-81e2-28719df406e2 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:04.992962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6541a-a9d5-45ca-ba29-21dc64271111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:04.995121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6541a-a9d5-45ca-ba29-21dc64271111 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.995574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6541a-a9d5-45ca-ba29-21dc64271111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.996031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6541a-a9d5-45ca-ba29-21dc64271111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.996766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6541a-a9d5-45ca-ba29-21dc64271111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:04.998469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6541a-a9d5-45ca-ba29-21dc64271111 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:05.010040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 956/1939] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:05.015222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2b138-2a31-44c4-893b-8b0585660298 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:05.026424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2b138-2a31-44c4-893b-8b0585660298 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:05.031590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6bc87-a779-4e3a-bc89-91f6ed0f95f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:05.032230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6bc87-a779-4e3a-bc89-91f6ed0f95f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:05.032513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6bc87-a779-4e3a-bc89-91f6ed0f95f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:05.032785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6bc87-a779-4e3a-bc89-91f6ed0f95f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:05.033524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6bc87-a779-4e3a-bc89-91f6ed0f95f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:05.035187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6bc87-a779-4e3a-bc89-91f6ed0f95f5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:05.052219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6541a-a9d5-45ca-ba29-21dc64271111 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:05.053053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 984/1940] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:05.059889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:05.064191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6541a-a9d5-45ca-ba29-21dc64271111 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:05.069103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e034b29-7efa-4a05-b828-f9a4a4595d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:05.069840 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e034b29-7efa-4a05-b828-f9a4a4595d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:05.070128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e034b29-7efa-4a05-b828-f9a4a4595d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:05.070448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e034b29-7efa-4a05-b828-f9a4a4595d81 admin admin] PATH_INFO: `/v3/projects/d0af93f7c6b54114b0e1b5c32e3bf623/users/2c4c72b9c83a4967b57b6633f9934dd4/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:05.087224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e034b29-7efa-4a05-b828-f9a4a4595d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0af93f7c6b54114b0e1b5c32e3bf623, user_id=2c4c72b9c83a4967b57b6633f9934dd4, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:05.090030 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e034b29-7efa-4a05-b828-f9a4a4595d81 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:05.155057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 957/1941] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:05 2022] PUT /identity/v3/projects/d0af93f7c6b54114b0e1b5c32e3bf623/users/2c4c72b9c83a4967b57b6633f9934dd4/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:05.163123 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0c9b4-f7c5-429d-b3fb-27a075d16b32 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:05.163625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0c9b4-f7c5-429d-b3fb-27a075d16b32 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:05.164111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0c9b4-f7c5-429d-b3fb-27a075d16b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:05.213046 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c2b0c9b4-f7c5-429d-b3fb-27a075d16b32 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:05.214382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c2b0c9b4-f7c5-429d-b3fb-27a075d16b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:05.321277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 985/1942] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:05.338769 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e034b29-7efa-4a05-b828-f9a4a4595d81 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:05.339389 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3e034b29-7efa-4a05-b828-f9a4a4595d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:05.417462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e034b29-7efa-4a05-b828-f9a4a4595d81 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:05.421074 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44323d-e5f0-4f50-ab42-d0fdaef5c002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:05.421730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44323d-e5f0-4f50-ab42-d0fdaef5c002 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:05.422013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44323d-e5f0-4f50-ab42-d0fdaef5c002 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:05.422289 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44323d-e5f0-4f50-ab42-d0fdaef5c002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:05.436499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44323d-e5f0-4f50-ab42-d0fdaef5c002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:05.436499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44323d-e5f0-4f50-ab42-d0fdaef5c002 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:05.482963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 958/1943] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:05.764229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0c9b4-f7c5-429d-b3fb-27a075d16b32 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:05.765957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c2b0c9b4-f7c5-429d-b3fb-27a075d16b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:05.779702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0c9b4-f7c5-429d-b3fb-27a075d16b32 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:05.784962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:05.785634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:05.785915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:05.786192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] PATH_INFO: `/v3/users/3c9720b2eace46ab9909227a9f8f3755` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:05.787479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9720b2eace46ab9909227a9f8f3755)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:05.789602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:06.084995 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:06.093860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9720b2eace46ab9909227a9f8f3755'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:06.102977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9720b2eace46ab9909227a9f8f3755'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:06.176629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9720b2eace46ab9909227a9f8f3755'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:06.177478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9720b2eace46ab9909227a9f8f3755'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:06.178168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9720b2eace46ab9909227a9f8f3755'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:06.201430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 986/1944] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:05 2022] DELETE /identity/v3/users/3c9720b2eace46ab9909227a9f8f3755 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:06.207995 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57e67f-023c-4848-8ebf-5dc01feaf047 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:06.208382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57e67f-023c-4848-8ebf-5dc01feaf047 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:06.210035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57e67f-023c-4848-8ebf-5dc01feaf047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:06.231115 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2d57e67f-023c-4848-8ebf-5dc01feaf047 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:06.245714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2d57e67f-023c-4848-8ebf-5dc01feaf047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:06.365441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 959/1945] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:06.379743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:06.382115 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:06.470615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac623f1-41f1-4589-bdae-b6ca9e927f3a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:06.475507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda6e02-000c-4972-b0a5-25b878c3fa96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:06.476002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda6e02-000c-4972-b0a5-25b878c3fa96 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:06.476434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda6e02-000c-4972-b0a5-25b878c3fa96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:06.476777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda6e02-000c-4972-b0a5-25b878c3fa96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:06.488334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda6e02-000c-4972-b0a5-25b878c3fa96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:06.491544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda6e02-000c-4972-b0a5-25b878c3fa96 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:06.508886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 987/1946] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:05:07.110034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57e67f-023c-4848-8ebf-5dc01feaf047 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:07.111630 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2d57e67f-023c-4848-8ebf-5dc01feaf047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:07.135180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57e67f-023c-4848-8ebf-5dc01feaf047 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:07.149029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:07.151252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:07.151728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:07.152380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] PATH_INFO: `/v3/projects/4dc09d2e90f0483c8cc393c9b4d2d90c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:07.154460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc09d2e90f0483c8cc393c9b4d2d90c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:07.157543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:07.320222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc09d2e90f0483c8cc393c9b4d2d90c', 'request_id': 'req-3553c818-8d66-4fad-a359-3421f506bcbd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:07.330095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc09d2e90f0483c8cc393c9b4d2d90c', 'request_id': 'req-3553c818-8d66-4fad-a359-3421f506bcbd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:07.426556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc09d2e90f0483c8cc393c9b4d2d90c', 'request_id': 'req-3553c818-8d66-4fad-a359-3421f506bcbd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:07.450827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] The token cache is being invalidate because project 4dc09d2e90f0483c8cc393c9b4d2d90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:07.450827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:07.453284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:07.456844 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 960/1947] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:07 2022] DELETE /identity/v3/projects/4dc09d2e90f0483c8cc393c9b4d2d90c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:07.461141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda6e02-000c-4972-b0a5-25b878c3fa96 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:07.474559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda6e02-000c-4972-b0a5-25b878c3fa96 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:07.575190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:07.576033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:07.576374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:07.576716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] PATH_INFO: `/v3/users/842745dee2474b98b1e6056d2239f0e4` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:07.579366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=842745dee2474b98b1e6056d2239f0e4)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:07.581563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:07.791852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842745dee2474b98b1e6056d2239f0e4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:07.812340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842745dee2474b98b1e6056d2239f0e4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:07.901548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842745dee2474b98b1e6056d2239f0e4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:07.902242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842745dee2474b98b1e6056d2239f0e4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:07.903193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0bd791ee-2725-42ce-b598-3a0d7f6fe5fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842745dee2474b98b1e6056d2239f0e4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:07.905168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:07.928230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 988/1948] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:07 2022] DELETE /identity/v3/users/842745dee2474b98b1e6056d2239f0e4 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:08.914005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:08.917675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:08.931968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553c818-8d66-4fad-a359-3421f506bcbd admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:08.938351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:09.050156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:09.051049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:09.051345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:09.051668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] PATH_INFO: `/v3/projects/479b4eaf255f49db8af7be2a7aeaabd3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:09.055560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=479b4eaf255f49db8af7be2a7aeaabd3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:09.074439 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:09.250497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479b4eaf255f49db8af7be2a7aeaabd3', 'request_id': 'req-04c2eca3-fb5f-47df-b4e1-9f65667a9851'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:09.260808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479b4eaf255f49db8af7be2a7aeaabd3', 'request_id': 'req-04c2eca3-fb5f-47df-b4e1-9f65667a9851'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:09.365907 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479b4eaf255f49db8af7be2a7aeaabd3', 'request_id': 'req-04c2eca3-fb5f-47df-b4e1-9f65667a9851'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:09.448722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] The token cache is being invalidate because project 479b4eaf255f49db8af7be2a7aeaabd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:09.449056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:09.454293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-04c2eca3-fb5f-47df-b4e1-9f65667a9851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:09.457094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 961/1949] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:08 2022] DELETE /identity/v3/projects/479b4eaf255f49db8af7be2a7aeaabd3 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:09.461745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5146cbe-600b-4d87-966c-d3232d485312 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:09.462322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5146cbe-600b-4d87-966c-d3232d485312 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:09.462409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5146cbe-600b-4d87-966c-d3232d485312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:09.502449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c5146cbe-600b-4d87-966c-d3232d485312 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:09.505063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c5146cbe-600b-4d87-966c-d3232d485312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:09.742212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 989/1950] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:09.745576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173820fd-1ba3-4c11-8744-3757cfeaa91a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:09.750600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173820fd-1ba3-4c11-8744-3757cfeaa91a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:09.750600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173820fd-1ba3-4c11-8744-3757cfeaa91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:09.820401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-173820fd-1ba3-4c11-8744-3757cfeaa91a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:09.823911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-173820fd-1ba3-4c11-8744-3757cfeaa91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:09.851056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 962/1951] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:09.859832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5146cbe-600b-4d87-966c-d3232d485312 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:09.884390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5146cbe-600b-4d87-966c-d3232d485312 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:09.907266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41542e54-ac4a-4234-a877-e59bc7b84447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:09.908446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41542e54-ac4a-4234-a877-e59bc7b84447 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:09.908850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41542e54-ac4a-4234-a877-e59bc7b84447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:09.909305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41542e54-ac4a-4234-a877-e59bc7b84447 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:09.910417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41542e54-ac4a-4234-a877-e59bc7b84447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:09.910907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41542e54-ac4a-4234-a877-e59bc7b84447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:09.919055 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41542e54-ac4a-4234-a877-e59bc7b84447 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:09.966276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 990/1952] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:09.968767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173820fd-1ba3-4c11-8744-3757cfeaa91a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:09.998902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173820fd-1ba3-4c11-8744-3757cfeaa91a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:10.008090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06374972-3718-4323-8c10-90cba35cef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:10.009593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06374972-3718-4323-8c10-90cba35cef11 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:10.010376 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06374972-3718-4323-8c10-90cba35cef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:10.011485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06374972-3718-4323-8c10-90cba35cef11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:10.013062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06374972-3718-4323-8c10-90cba35cef11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:10.019616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06374972-3718-4323-8c10-90cba35cef11 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:10.209626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 963/1953] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:09 2022] POST /identity/v3/projects => generated 363 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:10.210989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41542e54-ac4a-4234-a877-e59bc7b84447 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:10.255366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41542e54-ac4a-4234-a877-e59bc7b84447 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:10.437333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddc3c3-7aaa-418f-ae85-9aa8fe83017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:10.438859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddc3c3-7aaa-418f-ae85-9aa8fe83017b admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:10.439558 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddc3c3-7aaa-418f-ae85-9aa8fe83017b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:10.440200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddc3c3-7aaa-418f-ae85-9aa8fe83017b admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:10.441606 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddc3c3-7aaa-418f-ae85-9aa8fe83017b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:10.446885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddc3c3-7aaa-418f-ae85-9aa8fe83017b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:10.574715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 991/1954] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:10 2022] POST /identity/v3/users => generated 282 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:10.578676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06374972-3718-4323-8c10-90cba35cef11 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:10.593441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06374972-3718-4323-8c10-90cba35cef11 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:10.605880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff659-1616-4ded-a999-3d0adb8eea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:10.606796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff659-1616-4ded-a999-3d0adb8eea27 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:10.608291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff659-1616-4ded-a999-3d0adb8eea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:10.608733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff659-1616-4ded-a999-3d0adb8eea27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:10.610492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ff659-1616-4ded-a999-3d0adb8eea27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:10.614766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ff659-1616-4ded-a999-3d0adb8eea27 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:10.646225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 964/1955] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:10.650061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddc3c3-7aaa-418f-ae85-9aa8fe83017b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:10.668640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddc3c3-7aaa-418f-ae85-9aa8fe83017b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:10.699523 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3445b8-b3ed-4f36-8450-df5ec944bd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:10.703493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3445b8-b3ed-4f36-8450-df5ec944bd97 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:10.710250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3445b8-b3ed-4f36-8450-df5ec944bd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:10.712534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3445b8-b3ed-4f36-8450-df5ec944bd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:10.718289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3445b8-b3ed-4f36-8450-df5ec944bd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:10.726949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3445b8-b3ed-4f36-8450-df5ec944bd97 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:10.788907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 992/1956] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:10.791243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff659-1616-4ded-a999-3d0adb8eea27 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:10.812259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff659-1616-4ded-a999-3d0adb8eea27 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:10.818352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2cb4-a1e8-46d6-8048-5299136e3655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:10.834143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2cb4-a1e8-46d6-8048-5299136e3655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:10.834430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2cb4-a1e8-46d6-8048-5299136e3655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:10.834879 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2cb4-a1e8-46d6-8048-5299136e3655 admin admin] PATH_INFO: `/v3/projects/54d7952df4f24be586ea9f679e0398a0/users/291932fe162047fcad55235725759589/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:10.860272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c2cb4-a1e8-46d6-8048-5299136e3655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d7952df4f24be586ea9f679e0398a0, user_id=291932fe162047fcad55235725759589, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:10.865137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c2cb4-a1e8-46d6-8048-5299136e3655 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:10.950648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 965/1957] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:10 2022] PUT /identity/v3/projects/54d7952df4f24be586ea9f679e0398a0/users/291932fe162047fcad55235725759589/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:10.962575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efea0-a1cf-469f-856a-75479c52ccea None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:10.962989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efea0-a1cf-469f-856a-75479c52ccea None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:10.963702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efea0-a1cf-469f-856a-75479c52ccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.013956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a41efea0-a1cf-469f-856a-75479c52ccea None None] MFA Rules not processed for user `291932fe162047fcad55235725759589`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:11.015568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a41efea0-a1cf-469f-856a-75479c52ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:11.064992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:11.103145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 993/1958] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:11.104602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2cb4-a1e8-46d6-8048-5299136e3655 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:11.151188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:11.196465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2cb4-a1e8-46d6-8048-5299136e3655 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:11.202517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb10afb-b296-4603-8ae9-0fdbe1e12c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:11.203162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb10afb-b296-4603-8ae9-0fdbe1e12c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.203477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb10afb-b296-4603-8ae9-0fdbe1e12c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.203755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb10afb-b296-4603-8ae9-0fdbe1e12c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.204452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb10afb-b296-4603-8ae9-0fdbe1e12c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:11.206538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb10afb-b296-4603-8ae9-0fdbe1e12c43 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:11.337898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 966/1959] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:11 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:05:11.342191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41efea0-a1cf-469f-856a-75479c52ccea None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:11.354673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41efea0-a1cf-469f-856a-75479c52ccea None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:11.446312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a25be-dc4c-414e-811a-c976746dbd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:11.447323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a25be-dc4c-414e-811a-c976746dbd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.448129 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a25be-dc4c-414e-811a-c976746dbd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.448690 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a25be-dc4c-414e-811a-c976746dbd39 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.449705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a25be-dc4c-414e-811a-c976746dbd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:11.451609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a25be-dc4c-414e-811a-c976746dbd39 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:11.621391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 994/1960] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:11 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:05:11.628804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb10afb-b296-4603-8ae9-0fdbe1e12c43 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:11.646239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb10afb-b296-4603-8ae9-0fdbe1e12c43 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:11.654687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a09693-b481-4335-b65e-29fdfb7e8554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:11.655520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a09693-b481-4335-b65e-29fdfb7e8554 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.655899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a09693-b481-4335-b65e-29fdfb7e8554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.656433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a09693-b481-4335-b65e-29fdfb7e8554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.657334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a09693-b481-4335-b65e-29fdfb7e8554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:11.660000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a09693-b481-4335-b65e-29fdfb7e8554 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:11.676034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 967/1961] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:11.680723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a25be-dc4c-414e-811a-c976746dbd39 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:11.693004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a25be-dc4c-414e-811a-c976746dbd39 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:11.698961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0548ef-30f3-482e-989e-128bf15b655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:11.700266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0548ef-30f3-482e-989e-128bf15b655f admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.700613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0548ef-30f3-482e-989e-128bf15b655f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.700892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0548ef-30f3-482e-989e-128bf15b655f admin admin] PATH_INFO: `/v3/projects/d8e3252c35bd4d128aef029944da2c04/users/6171174645d54249b1410eabe08d77b4/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.722552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0548ef-30f3-482e-989e-128bf15b655f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e3252c35bd4d128aef029944da2c04, user_id=6171174645d54249b1410eabe08d77b4, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:11.726765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0548ef-30f3-482e-989e-128bf15b655f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:11.852448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a09693-b481-4335-b65e-29fdfb7e8554 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:11.883288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 995/1962] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:11 2022] PUT /identity/v3/projects/d8e3252c35bd4d128aef029944da2c04/users/6171174645d54249b1410eabe08d77b4/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:11.883390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a09693-b481-4335-b65e-29fdfb7e8554 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:12.015935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406451-8bb4-4cc1-b5dc-7dda4d1bbd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:12.016819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406451-8bb4-4cc1-b5dc-7dda4d1bbd92 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:12.017441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406451-8bb4-4cc1-b5dc-7dda4d1bbd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:12.017876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406451-8bb4-4cc1-b5dc-7dda4d1bbd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:12.020521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406451-8bb4-4cc1-b5dc-7dda4d1bbd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:12.024684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406451-8bb4-4cc1-b5dc-7dda4d1bbd92 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:12.063141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 968/1963] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:12.066290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0548ef-30f3-482e-989e-128bf15b655f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:12.083676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0548ef-30f3-482e-989e-128bf15b655f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:12.089961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b9234-2e14-4a02-ae5e-1e47b017f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:12.092025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9234-2e14-4a02-ae5e-1e47b017f250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:12.092025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9234-2e14-4a02-ae5e-1e47b017f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:12.092025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9234-2e14-4a02-ae5e-1e47b017f250 admin admin] PATH_INFO: `/v3/projects/d8e3252c35bd4d128aef029944da2c04/users/6171174645d54249b1410eabe08d77b4/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:12.095208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b9234-2e14-4a02-ae5e-1e47b017f250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e3252c35bd4d128aef029944da2c04, user_id=6171174645d54249b1410eabe08d77b4, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:12.099239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b9234-2e14-4a02-ae5e-1e47b017f250 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:12.125577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 996/1964] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:12 2022] PUT /identity/v3/projects/d8e3252c35bd4d128aef029944da2c04/users/6171174645d54249b1410eabe08d77b4/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:12.129931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7557726-7985-4c21-bf79-10dbb85897ec None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:12.130364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7557726-7985-4c21-bf79-10dbb85897ec None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:12.130447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7557726-7985-4c21-bf79-10dbb85897ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:12.205231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c7557726-7985-4c21-bf79-10dbb85897ec None None] MFA Rules not processed for user `6171174645d54249b1410eabe08d77b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:12.206516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c7557726-7985-4c21-bf79-10dbb85897ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:12.431285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 969/1965] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:12.463541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b9234-2e14-4a02-ae5e-1e47b017f250 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:12.465920 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-628b9234-2e14-4a02-ae5e-1e47b017f250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:12.567849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b9234-2e14-4a02-ae5e-1e47b017f250 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:12.571679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3153f5-2765-4189-8182-3900ede8acdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:12.572357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3153f5-2765-4189-8182-3900ede8acdc service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:12.572765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3153f5-2765-4189-8182-3900ede8acdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:12.573043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3153f5-2765-4189-8182-3900ede8acdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:12.583271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3153f5-2765-4189-8182-3900ede8acdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:12.584724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3153f5-2765-4189-8182-3900ede8acdc service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:12.596054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 997/1966] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:13.930513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7557726-7985-4c21-bf79-10dbb85897ec None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:13.995382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:14.041084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7557726-7985-4c21-bf79-10dbb85897ec None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:14.047647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:14.048606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:14.049103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:14.049627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] PATH_INFO: `/v3/users/291932fe162047fcad55235725759589` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:14.051174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=291932fe162047fcad55235725759589)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:14.065977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:14.340744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577866-85a5-4c03-a610-34dedd2b3fb1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:14.341349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577866-85a5-4c03-a610-34dedd2b3fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:14.341574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577866-85a5-4c03-a610-34dedd2b3fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:14.381662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8b577866-85a5-4c03-a610-34dedd2b3fb1 None None] MFA Rules not processed for user `2c4c72b9c83a4967b57b6633f9934dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:14.382195 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291932fe162047fcad55235725759589'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.383352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291932fe162047fcad55235725759589'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.383544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8b577866-85a5-4c03-a610-34dedd2b3fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:14.420513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:14.455263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291932fe162047fcad55235725759589'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.472357 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291932fe162047fcad55235725759589'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.488287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-227ee1e5-28c3-4b9f-b8d7-be980ed10ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291932fe162047fcad55235725759589'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.499431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 970/1967] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:13 2022] DELETE /identity/v3/users/291932fe162047fcad55235725759589 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:14.499647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 998/1968] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:14.502740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566499b8-7bde-4bd2-9ecd-13740d778dd3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:14.503127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566499b8-7bde-4bd2-9ecd-13740d778dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:14.503414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566499b8-7bde-4bd2-9ecd-13740d778dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:14.507045 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b577866-85a5-4c03-a610-34dedd2b3fb1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:14.508667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8b577866-85a5-4c03-a610-34dedd2b3fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:14.524233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b577866-85a5-4c03-a610-34dedd2b3fb1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:14.529197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-566499b8-7bde-4bd2-9ecd-13740d778dd3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:14.530910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-566499b8-7bde-4bd2-9ecd-13740d778dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:14.599216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be5a06-81e4-4d6a-9a8a-ff948d6a1904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:14.599867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5a06-81e4-4d6a-9a8a-ff948d6a1904 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:14.600157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5a06-81e4-4d6a-9a8a-ff948d6a1904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:14.600436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5a06-81e4-4d6a-9a8a-ff948d6a1904 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:14.601261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be5a06-81e4-4d6a-9a8a-ff948d6a1904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:14.604261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be5a06-81e4-4d6a-9a8a-ff948d6a1904 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:14.622246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 971/1969] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:14.635786 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566499b8-7bde-4bd2-9ecd-13740d778dd3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:14.635786 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-566499b8-7bde-4bd2-9ecd-13740d778dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:14.695773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:14.700348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566499b8-7bde-4bd2-9ecd-13740d778dd3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:14.704093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0e1f1-d9d3-4be6-ab01-741882fd77d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:14.704753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0e1f1-d9d3-4be6-ab01-741882fd77d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:14.705039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0e1f1-d9d3-4be6-ab01-741882fd77d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:14.705621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0e1f1-d9d3-4be6-ab01-741882fd77d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:14.716823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0e1f1-d9d3-4be6-ab01-741882fd77d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:14.718385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0e1f1-d9d3-4be6-ab01-741882fd77d4 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:14.729666 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 972/1970] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:05:14.809164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 999/1971] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:14 2022] POST /identity/v3/projects => generated 385 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:14.812870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0e1f1-d9d3-4be6-ab01-741882fd77d4 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:14.814645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-50c0e1f1-d9d3-4be6-ab01-741882fd77d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:14.831493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0e1f1-d9d3-4be6-ab01-741882fd77d4 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:14.905179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be5a06-81e4-4d6a-9a8a-ff948d6a1904 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:14.905179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c1be5a06-81e4-4d6a-9a8a-ff948d6a1904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:14.907759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c52a9-f8a8-4dfd-a269-6b8f2e713d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:14.908438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c52a9-f8a8-4dfd-a269-6b8f2e713d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:14.908729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c52a9-f8a8-4dfd-a269-6b8f2e713d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:14.909694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c52a9-f8a8-4dfd-a269-6b8f2e713d37 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:14.910361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c52a9-f8a8-4dfd-a269-6b8f2e713d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:14.915405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c52a9-f8a8-4dfd-a269-6b8f2e713d37 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:14.972062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be5a06-81e4-4d6a-9a8a-ff948d6a1904 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:14.982367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:14.983188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:14.983570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:14.983945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] PATH_INFO: `/v3/users/0c78dc942dc5435eadad651a3104080e` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:14.985473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c78dc942dc5435eadad651a3104080e)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:14.987551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:15.100156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 973/1972] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:14 2022] POST /identity/v3/users => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:15.102352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c52a9-f8a8-4dfd-a269-6b8f2e713d37 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:15.114759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c52a9-f8a8-4dfd-a269-6b8f2e713d37 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:15.120575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db65e7-f4b3-4c63-bac8-28c3ac2718b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:15.121534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db65e7-f4b3-4c63-bac8-28c3ac2718b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.121931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db65e7-f4b3-4c63-bac8-28c3ac2718b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.122528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db65e7-f4b3-4c63-bac8-28c3ac2718b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.123346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db65e7-f4b3-4c63-bac8-28c3ac2718b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:15.125179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db65e7-f4b3-4c63-bac8-28c3ac2718b8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:15.144958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 974/1973] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:15.147388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db65e7-f4b3-4c63-bac8-28c3ac2718b8 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:15.170429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db65e7-f4b3-4c63-bac8-28c3ac2718b8 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:15.170429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b10e9-7885-40d4-b25b-1ccc1ef36fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:15.170429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b10e9-7885-40d4-b25b-1ccc1ef36fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.170429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b10e9-7885-40d4-b25b-1ccc1ef36fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.170765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b10e9-7885-40d4-b25b-1ccc1ef36fa8 admin admin] PATH_INFO: `/v3/projects/b7234eb5e7404b15bd8b6470ecb23504/users/9c9f53322fe84793b65cdbe8eb8de041/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.187242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b10e9-7885-40d4-b25b-1ccc1ef36fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7234eb5e7404b15bd8b6470ecb23504, user_id=9c9f53322fe84793b65cdbe8eb8de041, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:15.189960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b10e9-7885-40d4-b25b-1ccc1ef36fa8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:15.392008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 975/1974] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:15 2022] PUT /identity/v3/projects/b7234eb5e7404b15bd8b6470ecb23504/users/9c9f53322fe84793b65cdbe8eb8de041/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:15.392008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b10e9-7885-40d4-b25b-1ccc1ef36fa8 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:15.394045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-798b10e9-7885-40d4-b25b-1ccc1ef36fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:15.406341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c78dc942dc5435eadad651a3104080e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.408173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:15.416681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c78dc942dc5435eadad651a3104080e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.485468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b10e9-7885-40d4-b25b-1ccc1ef36fa8 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:15.492448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:15.495012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.495012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.495012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] PATH_INFO: `/v3/projects/54d7952df4f24be586ea9f679e0398a0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.495573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c78dc942dc5435eadad651a3104080e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.496202 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d7952df4f24be586ea9f679e0398a0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:15.496548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c78dc942dc5435eadad651a3104080e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.498339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c78dc942dc5435eadad651a3104080e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.499010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:15.531436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1000/1975] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:14 2022] DELETE /identity/v3/users/0c78dc942dc5435eadad651a3104080e => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:15.532707 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:15.534398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:15.617602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:15.617602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d7952df4f24be586ea9f679e0398a0', 'request_id': 'req-18156a3c-b4bc-4697-b78a-990ede6f34cc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.624854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031dcb4-71a7-46e1-99d7-9949578e5a89 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:15.633783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d7952df4f24be586ea9f679e0398a0', 'request_id': 'req-18156a3c-b4bc-4697-b78a-990ede6f34cc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.716754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c52d63-219e-40e2-a27c-be4fbc7d0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:15.717458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c52d63-219e-40e2-a27c-be4fbc7d0eac admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.717767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c52d63-219e-40e2-a27c-be4fbc7d0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.718051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c52d63-219e-40e2-a27c-be4fbc7d0eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.719272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c52d63-219e-40e2-a27c-be4fbc7d0eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:15.720580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c52d63-219e-40e2-a27c-be4fbc7d0eac admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:15.737509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1001/1976] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:15.738984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f1024-5f74-4d19-8215-b75041ecb317 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.739285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f1024-5f74-4d19-8215-b75041ecb317 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.739566 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f1024-5f74-4d19-8215-b75041ecb317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.762346 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-157f1024-5f74-4d19-8215-b75041ecb317 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:15.763501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-157f1024-5f74-4d19-8215-b75041ecb317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:15.772233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1002/1977] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:15.773136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f1024-5f74-4d19-8215-b75041ecb317 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:15.777234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d7952df4f24be586ea9f679e0398a0', 'request_id': 'req-18156a3c-b4bc-4697-b78a-990ede6f34cc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.793421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] The token cache is being invalidate because project 54d7952df4f24be586ea9f679e0398a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:15.793720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.794104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f1024-5f74-4d19-8215-b75041ecb317 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:15.794433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.796184 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 976/1978] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:15 2022] DELETE /identity/v3/projects/54d7952df4f24be586ea9f679e0398a0 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:15.797137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:15.800880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:15.804794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2747e8d-d8a6-403d-8a5a-af7120e503fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:15.805520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747e8d-d8a6-403d-8a5a-af7120e503fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.805807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747e8d-d8a6-403d-8a5a-af7120e503fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.806086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747e8d-d8a6-403d-8a5a-af7120e503fa admin admin] PATH_INFO: `/v3/projects/b7234eb5e7404b15bd8b6470ecb23504/users/9c9f53322fe84793b65cdbe8eb8de041/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.809208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2747e8d-d8a6-403d-8a5a-af7120e503fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7234eb5e7404b15bd8b6470ecb23504, user_id=9c9f53322fe84793b65cdbe8eb8de041, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:15.811974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2747e8d-d8a6-403d-8a5a-af7120e503fa admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:15.825293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1003/1979] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:15 2022] PUT /identity/v3/projects/b7234eb5e7404b15bd8b6470ecb23504/users/9c9f53322fe84793b65cdbe8eb8de041/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:15.826447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2747e8d-d8a6-403d-8a5a-af7120e503fa admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:15.831243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d2747e8d-d8a6-403d-8a5a-af7120e503fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:15.889355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156a3c-b4bc-4697-b78a-990ede6f34cc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:15.934239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:15.953031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2747e8d-d8a6-403d-8a5a-af7120e503fa admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:15.953373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc5440-ad90-4fab-b38a-350ed25b859a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:15.954098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc5440-ad90-4fab-b38a-350ed25b859a service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.954452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc5440-ad90-4fab-b38a-350ed25b859a service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.954798 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc5440-ad90-4fab-b38a-350ed25b859a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.956928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-09cc5440-ad90-4fab-b38a-350ed25b859a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:15.958543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:15.959353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.959667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.959955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] PATH_INFO: `/v3/users/6171174645d54249b1410eabe08d77b4` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.961348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6171174645d54249b1410eabe08d77b4)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:15.964116 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:15.972491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc5440-ad90-4fab-b38a-350ed25b859a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:15.974234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc5440-ad90-4fab-b38a-350ed25b859a service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:15.987353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 977/1980] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:16.129108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6171174645d54249b1410eabe08d77b4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:16.142785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6171174645d54249b1410eabe08d77b4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:16.204541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6171174645d54249b1410eabe08d77b4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:16.206486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6171174645d54249b1410eabe08d77b4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:16.207985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6171174645d54249b1410eabe08d77b4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:16.258438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1004/1981] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:15 2022] DELETE /identity/v3/users/6171174645d54249b1410eabe08d77b4 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:16.886871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc5440-ad90-4fab-b38a-350ed25b859a service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:16.890131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-09cc5440-ad90-4fab-b38a-350ed25b859a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:16.912041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc5440-ad90-4fab-b38a-350ed25b859a service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:16.995223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:16.996353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:16.997446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:16.997929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] PATH_INFO: `/v3/projects/bc201b313634472e816c1a4ad98ec603` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.000621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc201b313634472e816c1a4ad98ec603)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:17.003922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:17.141857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:17.153025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc201b313634472e816c1a4ad98ec603', 'request_id': 'req-61c2b335-1675-4920-a7c7-f5622789dd83'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.162314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc201b313634472e816c1a4ad98ec603', 'request_id': 'req-61c2b335-1675-4920-a7c7-f5622789dd83'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.167939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:17.169731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:17.188004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f89fc-73d3-40bc-81f5-691cd9b3caed admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:17.233022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc201b313634472e816c1a4ad98ec603', 'request_id': 'req-61c2b335-1675-4920-a7c7-f5622789dd83'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.248397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] The token cache is being invalidate because project bc201b313634472e816c1a4ad98ec603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:17.248790 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.249445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.251599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 978/1982] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:16 2022] DELETE /identity/v3/projects/bc201b313634472e816c1a4ad98ec603 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:17.256297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:17.257904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:17.285086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:17.286339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:17.287247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:17.287631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] PATH_INFO: `/v3/projects/d8e3252c35bd4d128aef029944da2c04` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.289674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e3252c35bd4d128aef029944da2c04)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:17.292030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:17.374431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b335-1675-4920-a7c7-f5622789dd83 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:17.389751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:17.390980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:17.391722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:17.392227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] PATH_INFO: `/v3/users/54e59e71d8c84729b2db4126be553efc` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.394089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e59e71d8c84729b2db4126be553efc)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:17.396576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:17.461320 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e3252c35bd4d128aef029944da2c04', 'request_id': 'req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.483171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e3252c35bd4d128aef029944da2c04', 'request_id': 'req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.492957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e3252c35bd4d128aef029944da2c04', 'request_id': 'req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.579025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:17.585055 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] The token cache is being invalidate because project d8e3252c35bd4d128aef029944da2c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:17.585417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.586058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc1dacc4-ccbd-4e0a-b843-684d10c695fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.593441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1005/1983] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:17 2022] DELETE /identity/v3/projects/d8e3252c35bd4d128aef029944da2c04 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:17.595435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e937c-883f-4026-bc0a-e3b6d11d002f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:17.595435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e937c-883f-4026-bc0a-e3b6d11d002f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:17.595743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e937c-883f-4026-bc0a-e3b6d11d002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.620049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c76e937c-883f-4026-bc0a-e3b6d11d002f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:17.621334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c76e937c-883f-4026-bc0a-e3b6d11d002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:17.673026 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e59e71d8c84729b2db4126be553efc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.673854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e59e71d8c84729b2db4126be553efc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.745789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1006/1984] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:17.754923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8f1a7-cb59-409c-9fcd-4b9a4c189110 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:17.765215 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8f1a7-cb59-409c-9fcd-4b9a4c189110 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:17.765215 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8f1a7-cb59-409c-9fcd-4b9a4c189110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.781917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-06d8f1a7-cb59-409c-9fcd-4b9a4c189110 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:17.783234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-06d8f1a7-cb59-409c-9fcd-4b9a4c189110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:17.787093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e59e71d8c84729b2db4126be553efc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.794603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1007/1985] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:17.798904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8f1a7-cb59-409c-9fcd-4b9a4c189110 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:17.826172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8f1a7-cb59-409c-9fcd-4b9a4c189110 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:17.827070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e59e71d8c84729b2db4126be553efc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.827157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f430f4b-89cf-4481-9a5d-757eca0dc658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:17.827157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f430f4b-89cf-4481-9a5d-757eca0dc658 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:17.827157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f430f4b-89cf-4481-9a5d-757eca0dc658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:17.827157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f430f4b-89cf-4481-9a5d-757eca0dc658 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.827425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f430f4b-89cf-4481-9a5d-757eca0dc658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:17.827425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f430f4b-89cf-4481-9a5d-757eca0dc658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:17.827425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f430f4b-89cf-4481-9a5d-757eca0dc658 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:17.827628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e59e71d8c84729b2db4126be553efc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:17.838677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 979/1986] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:17 2022] DELETE /identity/v3/users/54e59e71d8c84729b2db4126be553efc => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:17.839448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1008/1987] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:17.845671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:17.845671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:17.991964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae2293-a31b-4627-b57a-5a6a57422040 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:17.998988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee4d44-6c89-428e-a576-51dfdf3c9157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:18.006923 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4d44-6c89-428e-a576-51dfdf3c9157 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:18.007610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4d44-6c89-428e-a576-51dfdf3c9157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:18.008139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4d44-6c89-428e-a576-51dfdf3c9157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:18.010767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee4d44-6c89-428e-a576-51dfdf3c9157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:18.014391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee4d44-6c89-428e-a576-51dfdf3c9157 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:18.263696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 980/1988] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:17 2022] POST /identity/v3/projects => generated 385 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:18.263959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f430f4b-89cf-4481-9a5d-757eca0dc658 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:18.263959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f430f4b-89cf-4481-9a5d-757eca0dc658 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:18.392831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f1644-6cb8-44de-9a46-45fcd47c0529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:18.393517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1644-6cb8-44de-9a46-45fcd47c0529 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:18.394985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1644-6cb8-44de-9a46-45fcd47c0529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:18.395339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1644-6cb8-44de-9a46-45fcd47c0529 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:18.396214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1644-6cb8-44de-9a46-45fcd47c0529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:18.398150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1644-6cb8-44de-9a46-45fcd47c0529 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:18.510767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1009/1989] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:18 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:18.512340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee4d44-6c89-428e-a576-51dfdf3c9157 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:18.529331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee4d44-6c89-428e-a576-51dfdf3c9157 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:18.544508 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b90c1-e1d4-412e-aad3-ee3b4385e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:18.545321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b90c1-e1d4-412e-aad3-ee3b4385e474 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:18.547253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b90c1-e1d4-412e-aad3-ee3b4385e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:18.547253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b90c1-e1d4-412e-aad3-ee3b4385e474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:18.547253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b90c1-e1d4-412e-aad3-ee3b4385e474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:18.554457 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b90c1-e1d4-412e-aad3-ee3b4385e474 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:18.576665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 981/1990] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:18.578038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f1644-6cb8-44de-9a46-45fcd47c0529 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:18.591795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f1644-6cb8-44de-9a46-45fcd47c0529 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:18.605090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4a8c-607d-493a-b974-c4ee22bf0abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:18.605090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4a8c-607d-493a-b974-c4ee22bf0abd admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:18.605090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4a8c-607d-493a-b974-c4ee22bf0abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:18.605090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4a8c-607d-493a-b974-c4ee22bf0abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:18.605604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4a8c-607d-493a-b974-c4ee22bf0abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:18.605690 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4a8c-607d-493a-b974-c4ee22bf0abd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:18.626828 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1010/1991] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:18.630825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b90c1-e1d4-412e-aad3-ee3b4385e474 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:18.643810 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b90c1-e1d4-412e-aad3-ee3b4385e474 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:18.649392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0d682-ef2b-4241-8dfb-6bd9ff4366ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:18.650759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0d682-ef2b-4241-8dfb-6bd9ff4366ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:18.651047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0d682-ef2b-4241-8dfb-6bd9ff4366ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:18.651326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0d682-ef2b-4241-8dfb-6bd9ff4366ef admin admin] PATH_INFO: `/v3/projects/5868e69ca37845d0b21dce331acc90bc/users/d4cf11ef3d6a414497561af48496b814/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:18.674644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0d682-ef2b-4241-8dfb-6bd9ff4366ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5868e69ca37845d0b21dce331acc90bc, user_id=d4cf11ef3d6a414497561af48496b814, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:18.675505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0d682-ef2b-4241-8dfb-6bd9ff4366ef admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:18.676095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4a8c-607d-493a-b974-c4ee22bf0abd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:18.678065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-daea4a8c-607d-493a-b974-c4ee22bf0abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:18.705671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4a8c-607d-493a-b974-c4ee22bf0abd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:18.720822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:18.721376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:18.721787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:18.721942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] PATH_INFO: `/v3/projects/86f57f29eb0f4140b5655f9fad8e34f5` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:18.726011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f57f29eb0f4140b5655f9fad8e34f5)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:18.728279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:18.760969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 982/1992] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:18 2022] PUT /identity/v3/projects/5868e69ca37845d0b21dce331acc90bc/users/d4cf11ef3d6a414497561af48496b814/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:18.776056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f0e56-7289-4bb9-9824-bba06285d672 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:18.776415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f0e56-7289-4bb9-9824-bba06285d672 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:18.776616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f0e56-7289-4bb9-9824-bba06285d672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:18.826522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9e2f0e56-7289-4bb9-9824-bba06285d672 None None] MFA Rules not processed for user `d4cf11ef3d6a414497561af48496b814`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:18.828057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9e2f0e56-7289-4bb9-9824-bba06285d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:18.844812 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:18.912750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f57f29eb0f4140b5655f9fad8e34f5', 'request_id': 'req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:18.925563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f57f29eb0f4140b5655f9fad8e34f5', 'request_id': 'req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:18.939471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f57f29eb0f4140b5655f9fad8e34f5', 'request_id': 'req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:18.955973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 983/1993] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:18.962096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f0e56-7289-4bb9-9824-bba06285d672 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:19.039697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f0e56-7289-4bb9-9824-bba06285d672 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:19.058877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] The token cache is being invalidate because project 86f57f29eb0f4140b5655f9fad8e34f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:19.059449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:19.060573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e287b887-bcd8-4b3d-8b32-7ad4d5d229a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:19.064089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1011/1994] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:18 2022] DELETE /identity/v3/projects/86f57f29eb0f4140b5655f9fad8e34f5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:19.069282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c0c30-70d0-4743-8ae7-856026e4ed20 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:19.069897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c0c30-70d0-4743-8ae7-856026e4ed20 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:19.070543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c0c30-70d0-4743-8ae7-856026e4ed20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:19.112398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-605c0c30-70d0-4743-8ae7-856026e4ed20 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:19.117063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-605c0c30-70d0-4743-8ae7-856026e4ed20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:19.187589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c81f3b-61e8-4984-990e-ce80ef1cfd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:19.188330 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c81f3b-61e8-4984-990e-ce80ef1cfd5c admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:19.188623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c81f3b-61e8-4984-990e-ce80ef1cfd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:19.188894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c81f3b-61e8-4984-990e-ce80ef1cfd5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:19.189612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c81f3b-61e8-4984-990e-ce80ef1cfd5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:19.192884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c81f3b-61e8-4984-990e-ce80ef1cfd5c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:19.242415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1012/1995] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:19.251124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc540bf7-90e3-4864-a198-7e6701b093b0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:19.251422 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc540bf7-90e3-4864-a198-7e6701b093b0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:19.252296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc540bf7-90e3-4864-a198-7e6701b093b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:19.273956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-fc540bf7-90e3-4864-a198-7e6701b093b0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:19.275846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fc540bf7-90e3-4864-a198-7e6701b093b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:19.288236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1013/1996] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:19.289233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc540bf7-90e3-4864-a198-7e6701b093b0 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:19.299253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc540bf7-90e3-4864-a198-7e6701b093b0 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:19.309282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 984/1997] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:18 2022] POST /identity/v3/projects => generated 387 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:19.313164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c81f3b-61e8-4984-990e-ce80ef1cfd5c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:19.315756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-58c81f3b-61e8-4984-990e-ce80ef1cfd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:19.318649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2679a-dfff-4c5a-b288-9ef4f03a6729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:19.319293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2679a-dfff-4c5a-b288-9ef4f03a6729 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:19.319571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2679a-dfff-4c5a-b288-9ef4f03a6729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:19.319843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2679a-dfff-4c5a-b288-9ef4f03a6729 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:19.320551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2679a-dfff-4c5a-b288-9ef4f03a6729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:19.320852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2679a-dfff-4c5a-b288-9ef4f03a6729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:19.322691 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2679a-dfff-4c5a-b288-9ef4f03a6729 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:19.355104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1014/1998] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:19.361220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2679a-dfff-4c5a-b288-9ef4f03a6729 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:19.378026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2679a-dfff-4c5a-b288-9ef4f03a6729 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:19.423027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c81f3b-61e8-4984-990e-ce80ef1cfd5c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:19.431014 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0e457-7c5f-427f-9ce3-009305686ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:19.431734 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0e457-7c5f-427f-9ce3-009305686ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:19.432035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0e457-7c5f-427f-9ce3-009305686ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:19.432405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0e457-7c5f-427f-9ce3-009305686ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:19.433148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0e457-7c5f-427f-9ce3-009305686ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:19.435326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0e457-7c5f-427f-9ce3-009305686ef2 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:19.458030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fdc99-5d3c-452f-ad51-da3365354ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:19.458664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fdc99-5d3c-452f-ad51-da3365354ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:19.458944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fdc99-5d3c-452f-ad51-da3365354ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:19.459509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fdc99-5d3c-452f-ad51-da3365354ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:19.460318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fdc99-5d3c-452f-ad51-da3365354ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:19.463405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fdc99-5d3c-452f-ad51-da3365354ff5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:19.679780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:19.688091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 985/1999] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:19 2022] POST /identity/v3/users => generated 300 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:05:19.692158 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0e457-7c5f-427f-9ce3-009305686ef2 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:19.709571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1015/2000] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:19 2022] POST /identity/v3/projects => generated 387 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:19.722596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fdc99-5d3c-452f-ad51-da3365354ff5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:19.732020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0e457-7c5f-427f-9ce3-009305686ef2 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:19.814149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cf435-5647-4d1a-a207-bc82361dbc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:19.814786 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cf435-5647-4d1a-a207-bc82361dbc10 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:19.815066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cf435-5647-4d1a-a207-bc82361dbc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:19.815336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cf435-5647-4d1a-a207-bc82361dbc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:19.816372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cf435-5647-4d1a-a207-bc82361dbc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:19.818069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cf435-5647-4d1a-a207-bc82361dbc10 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:19.835064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fdc99-5d3c-452f-ad51-da3365354ff5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:19.838172 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 986/2001] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:19.845657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cf435-5647-4d1a-a207-bc82361dbc10 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:19.854197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8753e0-b953-4790-b634-8928165a7a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:19.856397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8753e0-b953-4790-b634-8928165a7a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:19.856923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8753e0-b953-4790-b634-8928165a7a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:19.857940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8753e0-b953-4790-b634-8928165a7a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:19.858972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8753e0-b953-4790-b634-8928165a7a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:19.861469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cf435-5647-4d1a-a207-bc82361dbc10 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:19.861894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8753e0-b953-4790-b634-8928165a7a30 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:19.874303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a87ce-9e42-44c6-8b79-f0982cda4f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:19.874992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a87ce-9e42-44c6-8b79-f0982cda4f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:19.875269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a87ce-9e42-44c6-8b79-f0982cda4f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:19.875600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a87ce-9e42-44c6-8b79-f0982cda4f54 admin admin] PATH_INFO: `/v3/projects/82badd1215174b499fee1b83ddbf816a/users/3b4289f9f3284f6e8654d0f24bf62c81/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:19.900872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a87ce-9e42-44c6-8b79-f0982cda4f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82badd1215174b499fee1b83ddbf816a, user_id=3b4289f9f3284f6e8654d0f24bf62c81, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:19.904137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a87ce-9e42-44c6-8b79-f0982cda4f54 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.001243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 987/2002] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:19 2022] PUT /identity/v3/projects/82badd1215174b499fee1b83ddbf816a/users/3b4289f9f3284f6e8654d0f24bf62c81/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:20.001448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1016/2003] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:19 2022] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:20.002633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a87ce-9e42-44c6-8b79-f0982cda4f54 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.002863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8753e0-b953-4790-b634-8928165a7a30 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.013404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8753e0-b953-4790-b634-8928165a7a30 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.075525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a87ce-9e42-44c6-8b79-f0982cda4f54 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.081018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c123a6-9174-46d6-8f62-b985d4f152cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.082009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c123a6-9174-46d6-8f62-b985d4f152cd admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.082297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c123a6-9174-46d6-8f62-b985d4f152cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.082663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c123a6-9174-46d6-8f62-b985d4f152cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.083260 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c123a6-9174-46d6-8f62-b985d4f152cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.085021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c123a6-9174-46d6-8f62-b985d4f152cd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.088109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45029736-8cd1-4904-a8da-e3df4ddd4c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.088742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029736-8cd1-4904-a8da-e3df4ddd4c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.089028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029736-8cd1-4904-a8da-e3df4ddd4c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.089336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029736-8cd1-4904-a8da-e3df4ddd4c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.090908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45029736-8cd1-4904-a8da-e3df4ddd4c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.094996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45029736-8cd1-4904-a8da-e3df4ddd4c58 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.098740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 988/2004] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:20.102578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c123a6-9174-46d6-8f62-b985d4f152cd admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.111876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1017/2005] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:20.113410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c123a6-9174-46d6-8f62-b985d4f152cd admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.115810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45029736-8cd1-4904-a8da-e3df4ddd4c58 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.118288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b700e1c-6ddd-4f18-80bd-93f398c1922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.119971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b700e1c-6ddd-4f18-80bd-93f398c1922f admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.120256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b700e1c-6ddd-4f18-80bd-93f398c1922f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.120536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b700e1c-6ddd-4f18-80bd-93f398c1922f admin admin] PATH_INFO: `/v3/projects/82badd1215174b499fee1b83ddbf816a/users/3b4289f9f3284f6e8654d0f24bf62c81/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.122809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b700e1c-6ddd-4f18-80bd-93f398c1922f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82badd1215174b499fee1b83ddbf816a, user_id=3b4289f9f3284f6e8654d0f24bf62c81, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.131694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45029736-8cd1-4904-a8da-e3df4ddd4c58 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.137543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b700e1c-6ddd-4f18-80bd-93f398c1922f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.139304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939e99e-2951-4308-98a9-7e59c54e917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.139950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939e99e-2951-4308-98a9-7e59c54e917d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.140243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939e99e-2951-4308-98a9-7e59c54e917d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.140529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939e99e-2951-4308-98a9-7e59c54e917d admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.141271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939e99e-2951-4308-98a9-7e59c54e917d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.143514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939e99e-2951-4308-98a9-7e59c54e917d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.160802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1018/2006] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:20.164908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939e99e-2951-4308-98a9-7e59c54e917d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.167790 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 989/2007] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:20 2022] PUT /identity/v3/projects/82badd1215174b499fee1b83ddbf816a/users/3b4289f9f3284f6e8654d0f24bf62c81/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:20.178436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91184ee-4520-4736-ae53-cdd74a86d564 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.178967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91184ee-4520-4736-ae53-cdd74a86d564 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.179662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91184ee-4520-4736-ae53-cdd74a86d564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.212688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939e99e-2951-4308-98a9-7e59c54e917d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.264728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e91184ee-4520-4736-ae53-cdd74a86d564 None None] MFA Rules not processed for user `3b4289f9f3284f6e8654d0f24bf62c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:20.266183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e91184ee-4520-4736-ae53-cdd74a86d564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:20.328128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521618b-d72e-4a21-9e94-0d1b648655d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.332969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521618b-d72e-4a21-9e94-0d1b648655d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.332969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521618b-d72e-4a21-9e94-0d1b648655d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.332969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521618b-d72e-4a21-9e94-0d1b648655d7 admin admin] PATH_INFO: `/v3/projects/3f3bf607297442929120b7803e33c5eb/users/8db0619671bb4962b5853587d854e29b/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.347318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521618b-d72e-4a21-9e94-0d1b648655d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3bf607297442929120b7803e33c5eb, user_id=8db0619671bb4962b5853587d854e29b, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.350625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521618b-d72e-4a21-9e94-0d1b648655d7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.381185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 990/2008] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:20.398351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91184ee-4520-4736-ae53-cdd74a86d564 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.400094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e91184ee-4520-4736-ae53-cdd74a86d564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:20.518941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1019/2009] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:20 2022] PUT /identity/v3/projects/3f3bf607297442929120b7803e33c5eb/users/8db0619671bb4962b5853587d854e29b/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:20.528973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72731-a1de-4540-a322-2cf90469182b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.529289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72731-a1de-4540-a322-2cf90469182b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.529569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72731-a1de-4540-a322-2cf90469182b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.548809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91184ee-4520-4736-ae53-cdd74a86d564 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.611402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9da72731-a1de-4540-a322-2cf90469182b None None] MFA Rules not processed for user `8db0619671bb4962b5853587d854e29b`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:20.612683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9da72731-a1de-4540-a322-2cf90469182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:20.740435 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf3958-125e-4030-8f57-08666fc5c6c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.741198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3958-125e-4030-8f57-08666fc5c6c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.741496 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3958-125e-4030-8f57-08666fc5c6c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.741780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3958-125e-4030-8f57-08666fc5c6c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.792449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1020/2010] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:20.805605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da72731-a1de-4540-a322-2cf90469182b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.896123 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf3958-125e-4030-8f57-08666fc5c6c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.897993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf3958-125e-4030-8f57-08666fc5c6c7 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.911012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 991/2011] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:05:20.926505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da72731-a1de-4540-a322-2cf90469182b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.932800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a31c6e-71b4-412d-b6f5-ca6294a5f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.933181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a31c6e-71b4-412d-b6f5-ca6294a5f1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.933536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a31c6e-71b4-412d-b6f5-ca6294a5f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.933879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a31c6e-71b4-412d-b6f5-ca6294a5f1b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.934740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a31c6e-71b4-412d-b6f5-ca6294a5f1b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.938084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a31c6e-71b4-412d-b6f5-ca6294a5f1b0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.965576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf3958-125e-4030-8f57-08666fc5c6c7 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.994994 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf3958-125e-4030-8f57-08666fc5c6c7 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:21.001142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:21.001982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.002740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.003173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] PATH_INFO: `/v3/users/d4cf11ef3d6a414497561af48496b814` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:21.004659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4cf11ef3d6a414497561af48496b814)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:21.006984 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:21.076701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1021/2012] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:20 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:21.080564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a31c6e-71b4-412d-b6f5-ca6294a5f1b0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:21.209792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a31c6e-71b4-412d-b6f5-ca6294a5f1b0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:21.236277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b49f7-918a-4dcb-a34c-8492cee9ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:21.236277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b49f7-918a-4dcb-a34c-8492cee9ad8c admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.236277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b49f7-918a-4dcb-a34c-8492cee9ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.236277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b49f7-918a-4dcb-a34c-8492cee9ad8c admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:21.236972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b49f7-918a-4dcb-a34c-8492cee9ad8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:21.236972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b49f7-918a-4dcb-a34c-8492cee9ad8c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:21.597463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:21.597865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1022/2013] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:21 2022] POST /identity/v3/users => generated 300 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:05:21.599272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b49f7-918a-4dcb-a34c-8492cee9ad8c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:21.608838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4cf11ef3d6a414497561af48496b814'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:21.609539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4cf11ef3d6a414497561af48496b814'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:21.611482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b49f7-918a-4dcb-a34c-8492cee9ad8c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:21.625763 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4673a7-6f24-40c2-baae-a036e00124fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:21.626538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4673a7-6f24-40c2-baae-a036e00124fc admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.626921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4673a7-6f24-40c2-baae-a036e00124fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.627281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4673a7-6f24-40c2-baae-a036e00124fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:21.628088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4673a7-6f24-40c2-baae-a036e00124fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:21.629842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4673a7-6f24-40c2-baae-a036e00124fc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:21.641770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1023/2014] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:21.658618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4673a7-6f24-40c2-baae-a036e00124fc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:21.669948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4673a7-6f24-40c2-baae-a036e00124fc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:21.674748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948031e4-9609-4dce-96d2-2f300c9c2d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:21.675443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948031e4-9609-4dce-96d2-2f300c9c2d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.675728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948031e4-9609-4dce-96d2-2f300c9c2d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.676008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948031e4-9609-4dce-96d2-2f300c9c2d0d admin admin] PATH_INFO: `/v3/projects/b174270a3714432f9fa00d47c08dc5d7/users/4d7424711e1047a299e744c07c1bba4e/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:21.694321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948031e4-9609-4dce-96d2-2f300c9c2d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b174270a3714432f9fa00d47c08dc5d7, user_id=4d7424711e1047a299e744c07c1bba4e, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:21.698470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948031e4-9609-4dce-96d2-2f300c9c2d0d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:21.907538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4cf11ef3d6a414497561af48496b814'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:21.918503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1024/2015] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:21 2022] PUT /identity/v3/projects/b174270a3714432f9fa00d47c08dc5d7/users/4d7424711e1047a299e744c07c1bba4e/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:21.922259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948031e4-9609-4dce-96d2-2f300c9c2d0d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:21.951534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4cf11ef3d6a414497561af48496b814'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:21.951534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f19f243e-c714-4cea-a2cc-303764328047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4cf11ef3d6a414497561af48496b814'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:21.961150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 992/2016] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:20 2022] DELETE /identity/v3/users/d4cf11ef3d6a414497561af48496b814 => generated 0 bytes in 996 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:21.966973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cef4-8b3f-4cee-908b-7ccddfec051a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.967521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cef4-8b3f-4cee-908b-7ccddfec051a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.968088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cef4-8b3f-4cee-908b-7ccddfec051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:22.011405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948031e4-9609-4dce-96d2-2f300c9c2d0d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:22.036091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-cff9cef4-8b3f-4cee-908b-7ccddfec051a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:22.039121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cff9cef4-8b3f-4cee-908b-7ccddfec051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:22.179130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c5e35-de03-4798-a940-8eac14be8a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:22.179955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5e35-de03-4798-a940-8eac14be8a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:22.180371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5e35-de03-4798-a940-8eac14be8a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:22.180744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5e35-de03-4798-a940-8eac14be8a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:22.182281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c5e35-de03-4798-a940-8eac14be8a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:22.188053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c5e35-de03-4798-a940-8eac14be8a1a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:22.200533 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 993/2017] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:22.221212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1025/2018] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:22.234819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9cef4-8b3f-4cee-908b-7ccddfec051a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:22.236395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cff9cef4-8b3f-4cee-908b-7ccddfec051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:22.248156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c5e35-de03-4798-a940-8eac14be8a1a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:22.257161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-569c5e35-de03-4798-a940-8eac14be8a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:22.258306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9cef4-8b3f-4cee-908b-7ccddfec051a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:22.278150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b3947-8753-44e8-aca4-97d17d672494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:22.278859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3947-8753-44e8-aca4-97d17d672494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:22.279132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3947-8753-44e8-aca4-97d17d672494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:22.279409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3947-8753-44e8-aca4-97d17d672494 admin admin] PATH_INFO: `/v3/projects/b174270a3714432f9fa00d47c08dc5d7/users/4d7424711e1047a299e744c07c1bba4e/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:22.283250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b3947-8753-44e8-aca4-97d17d672494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b174270a3714432f9fa00d47c08dc5d7, user_id=4d7424711e1047a299e744c07c1bba4e, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:22.292941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b3947-8753-44e8-aca4-97d17d672494 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:22.336521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 994/2019] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:22 2022] PUT /identity/v3/projects/b174270a3714432f9fa00d47c08dc5d7/users/4d7424711e1047a299e744c07c1bba4e/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:22.348972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741c7be-9503-469a-b363-2d1b962cd040 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:22.349296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741c7be-9503-469a-b363-2d1b962cd040 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:22.349576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741c7be-9503-469a-b363-2d1b962cd040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:22.425988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c5e35-de03-4798-a940-8eac14be8a1a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:22.447822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f741c7be-9503-469a-b363-2d1b962cd040 None None] MFA Rules not processed for user `4d7424711e1047a299e744c07c1bba4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:22.449157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f741c7be-9503-469a-b363-2d1b962cd040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:22.550312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9374fb4-8f1e-45ff-b92e-cb33fd86eea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:22.551937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374fb4-8f1e-45ff-b92e-cb33fd86eea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:22.552156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374fb4-8f1e-45ff-b92e-cb33fd86eea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:22.552990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374fb4-8f1e-45ff-b92e-cb33fd86eea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:22.581309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 995/2020] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:22.596475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741c7be-9503-469a-b363-2d1b962cd040 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:22.598638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f741c7be-9503-469a-b363-2d1b962cd040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:22.631204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9374fb4-8f1e-45ff-b92e-cb33fd86eea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:22.633253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9374fb4-8f1e-45ff-b92e-cb33fd86eea8 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:22.644850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1026/2021] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:22.682913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741c7be-9503-469a-b363-2d1b962cd040 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:22.686660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268b15d-7d13-49ec-9178-decdc6380d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:22.687318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268b15d-7d13-49ec-9178-decdc6380d10 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:22.687597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268b15d-7d13-49ec-9178-decdc6380d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:22.687869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268b15d-7d13-49ec-9178-decdc6380d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:22.698913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268b15d-7d13-49ec-9178-decdc6380d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:22.700401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268b15d-7d13-49ec-9178-decdc6380d10 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:22.710859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 996/2022] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:05:22.712083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:22.791578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9374fb4-8f1e-45ff-b92e-cb33fd86eea8 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:22.802554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9374fb4-8f1e-45ff-b92e-cb33fd86eea8 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:22.808189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:22.808838 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:22.809154 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:22.809435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] PATH_INFO: `/v3/users/8db0619671bb4962b5853587d854e29b` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:22.810763 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db0619671bb4962b5853587d854e29b)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:22.813211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:23.092552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db0619671bb4962b5853587d854e29b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:23.100006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db0619671bb4962b5853587d854e29b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:23.215095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db0619671bb4962b5853587d854e29b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:23.215655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db0619671bb4962b5853587d854e29b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:23.216276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db0619671bb4962b5853587d854e29b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:23.246050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1027/2023] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:22 2022] DELETE /identity/v3/users/8db0619671bb4962b5853587d854e29b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:23.247901 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdda24-afa4-47cf-affe-9c7c56b434e8 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:23.248525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdda24-afa4-47cf-affe-9c7c56b434e8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:23.248810 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdda24-afa4-47cf-affe-9c7c56b434e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:23.269984 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-40fdda24-afa4-47cf-affe-9c7c56b434e8 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:23.271479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-40fdda24-afa4-47cf-affe-9c7c56b434e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:23.380277 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 997/2024] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:23.393968 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:23.396861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:23.462260 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:23.503325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591803f-7252-4e1b-9817-a00bbb52f109 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:23.514238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f3016-80ba-4fa1-8b30-b3050673a419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:23.515008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f3016-80ba-4fa1-8b30-b3050673a419 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:23.515292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f3016-80ba-4fa1-8b30-b3050673a419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:23.515575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f3016-80ba-4fa1-8b30-b3050673a419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:23.530803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f3016-80ba-4fa1-8b30-b3050673a419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:23.532866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f3016-80ba-4fa1-8b30-b3050673a419 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:23.548800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1028/2025] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:23.631633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdda24-afa4-47cf-affe-9c7c56b434e8 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:23.633997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-40fdda24-afa4-47cf-affe-9c7c56b434e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:23.648020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdda24-afa4-47cf-affe-9c7c56b434e8 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:23.655270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:23.656222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:23.656672 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:23.657024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] PATH_INFO: `/v3/projects/5868e69ca37845d0b21dce331acc90bc` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:23.658423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5868e69ca37845d0b21dce331acc90bc)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:23.661016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:23.796072 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5868e69ca37845d0b21dce331acc90bc', 'request_id': 'req-527483a2-623c-48d7-8193-590fe73c71b8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:23.808578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5868e69ca37845d0b21dce331acc90bc', 'request_id': 'req-527483a2-623c-48d7-8193-590fe73c71b8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:23.863263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5868e69ca37845d0b21dce331acc90bc', 'request_id': 'req-527483a2-623c-48d7-8193-590fe73c71b8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:23.910204 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] The token cache is being invalidate because project 5868e69ca37845d0b21dce331acc90bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:23.910368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:23.917813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:23.923877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 998/2026] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:23 2022] DELETE /identity/v3/projects/5868e69ca37845d0b21dce331acc90bc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:23.924860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f3016-80ba-4fa1-8b30-b3050673a419 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:23.936924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f3016-80ba-4fa1-8b30-b3050673a419 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:24.024655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:24.026276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:24.027012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:24.028029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] PATH_INFO: `/v3/users/3b4289f9f3284f6e8654d0f24bf62c81` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:24.029626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4289f9f3284f6e8654d0f24bf62c81)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:24.032145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:24.334948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4289f9f3284f6e8654d0f24bf62c81'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:24.342290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:24.349223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4289f9f3284f6e8654d0f24bf62c81'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:24.415808 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:24.450987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4289f9f3284f6e8654d0f24bf62c81'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:24.451946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4289f9f3284f6e8654d0f24bf62c81'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:24.452756 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4289f9f3284f6e8654d0f24bf62c81'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:24.476705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:24.478549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:24.490460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1029/2027] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:23 2022] DELETE /identity/v3/users/3b4289f9f3284f6e8654d0f24bf62c81 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:24.503785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527483a2-623c-48d7-8193-590fe73c71b8 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:24.586566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:24.587629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:24.588355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:24.588816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] PATH_INFO: `/v3/users/8b36de6b78d1404b8bc8e9188a59a834` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:24.590909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b36de6b78d1404b8bc8e9188a59a834)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:24.593085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:24.837547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b36de6b78d1404b8bc8e9188a59a834'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:24.838225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b36de6b78d1404b8bc8e9188a59a834'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:24.929668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b36de6b78d1404b8bc8e9188a59a834'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:24.946081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b36de6b78d1404b8bc8e9188a59a834'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:24.946846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:24.948439 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:24.954340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b36de6b78d1404b8bc8e9188a59a834'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:24.962160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 999/2028] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:24 2022] DELETE /identity/v3/users/8b36de6b78d1404b8bc8e9188a59a834 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:24.979991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295ea87-1c9d-4a2c-a38c-58c1f2468c12 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:24.999831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:25.001351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:25.172907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:25.173617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:25.173897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:25.174390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] PATH_INFO: `/v3/projects/3f3bf607297442929120b7803e33c5eb` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:25.176502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3bf607297442929120b7803e33c5eb)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:25.178674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:25.185924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017de1fa-77e7-458a-9a2f-c108cf030e7e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:25.195901 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:25.196684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:25.197189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:25.197576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] PATH_INFO: `/v3/projects/82badd1215174b499fee1b83ddbf816a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:25.198881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=82badd1215174b499fee1b83ddbf816a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:25.200860 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:25.295220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:25.384117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3bf607297442929120b7803e33c5eb', 'request_id': 'req-4665ad86-8533-4716-befc-8f5fb3a62c31'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.391183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3bf607297442929120b7803e33c5eb', 'request_id': 'req-4665ad86-8533-4716-befc-8f5fb3a62c31'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.400506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:25.401223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3bf607297442929120b7803e33c5eb', 'request_id': 'req-4665ad86-8533-4716-befc-8f5fb3a62c31'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.431277 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82badd1215174b499fee1b83ddbf816a', 'request_id': 'req-7de8f24d-7eff-49c5-be94-6928f4f3e4de'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.445681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82badd1215174b499fee1b83ddbf816a', 'request_id': 'req-7de8f24d-7eff-49c5-be94-6928f4f3e4de'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.506176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] The token cache is being invalidate because project 3f3bf607297442929120b7803e33c5eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:25.506577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.507438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.510182 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1030/2029] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:24 2022] DELETE /identity/v3/projects/3f3bf607297442929120b7803e33c5eb => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:25.511450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:25.513368 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:25.598437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665ad86-8533-4716-befc-8f5fb3a62c31 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:25.615113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82badd1215174b499fee1b83ddbf816a', 'request_id': 'req-7de8f24d-7eff-49c5-be94-6928f4f3e4de'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.627581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] The token cache is being invalidate because project 82badd1215174b499fee1b83ddbf816a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:25.627871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.628717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.630341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1000/2030] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:24 2022] DELETE /identity/v3/projects/82badd1215174b499fee1b83ddbf816a => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:25.635501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:25.637299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:25.672754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:25.673709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:25.674116 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:25.675183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] PATH_INFO: `/v3/projects/6e5a33a693e8430c9e64675f871c2f6c` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:25.676073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5a33a693e8430c9e64675f871c2f6c)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:25.679162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:25.737753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8f24d-7eff-49c5-be94-6928f4f3e4de admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:25.742865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:25.743545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:25.743833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:25.744111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] PATH_INFO: `/v3/users/4d7424711e1047a299e744c07c1bba4e` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:25.745388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7424711e1047a299e744c07c1bba4e)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:25.747357 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:25.827444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5a33a693e8430c9e64675f871c2f6c', 'request_id': 'req-3d153d5c-29ce-48ba-9f28-02c9c57193c8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.835101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5a33a693e8430c9e64675f871c2f6c', 'request_id': 'req-3d153d5c-29ce-48ba-9f28-02c9c57193c8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.845813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5a33a693e8430c9e64675f871c2f6c', 'request_id': 'req-3d153d5c-29ce-48ba-9f28-02c9c57193c8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.982961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] The token cache is being invalidate because project 6e5a33a693e8430c9e64675f871c2f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:25.983895 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.986677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d153d5c-29ce-48ba-9f28-02c9c57193c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:25.991352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1031/2031] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:25 2022] DELETE /identity/v3/projects/6e5a33a693e8430c9e64675f871c2f6c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:25.991352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cba74-daa5-4541-8bf2-7b16fefafe5d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:25.991352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cba74-daa5-4541-8bf2-7b16fefafe5d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:25.991352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cba74-daa5-4541-8bf2-7b16fefafe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.017859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-228cba74-daa5-4541-8bf2-7b16fefafe5d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:26.019364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-228cba74-daa5-4541-8bf2-7b16fefafe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:26.091773 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1032/2032] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:26.093372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cba74-daa5-4541-8bf2-7b16fefafe5d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:26.094681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-228cba74-daa5-4541-8bf2-7b16fefafe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:26.113840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cba74-daa5-4541-8bf2-7b16fefafe5d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:26.122782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:26.123875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:26.124856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:26.124856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] PATH_INFO: `/v3/users/b16e1b13f1ac408eb1448b7207f2432b` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.126252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16e1b13f1ac408eb1448b7207f2432b)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:26.128973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:26.129733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7424711e1047a299e744c07c1bba4e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:26.131076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7424711e1047a299e744c07c1bba4e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:26.249991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7424711e1047a299e744c07c1bba4e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:26.263599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7424711e1047a299e744c07c1bba4e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:26.271915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff3b8df0-b5ed-4ca9-9876-e6312affb1d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7424711e1047a299e744c07c1bba4e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:26.281347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1001/2033] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:25 2022] DELETE /identity/v3/users/4d7424711e1047a299e744c07c1bba4e => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:26.282968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e081a1-8cf9-4c63-9df3-47ac4feedadb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:26.283352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e081a1-8cf9-4c63-9df3-47ac4feedadb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:26.283726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e081a1-8cf9-4c63-9df3-47ac4feedadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.308450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-10e081a1-8cf9-4c63-9df3-47ac4feedadb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:26.309924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-10e081a1-8cf9-4c63-9df3-47ac4feedadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:26.398099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1002/2034] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:26.399650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d68c-0de1-428e-9694-61819de5db5a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:26.400035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d68c-0de1-428e-9694-61819de5db5a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:26.400311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d68c-0de1-428e-9694-61819de5db5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.402938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16e1b13f1ac408eb1448b7207f2432b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:26.420933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16e1b13f1ac408eb1448b7207f2432b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:26.434063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-62b8d68c-0de1-428e-9694-61819de5db5a None None] MFA Rules not processed for user `9c9f53322fe84793b65cdbe8eb8de041`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:26.436206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-62b8d68c-0de1-428e-9694-61819de5db5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:26.490010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16e1b13f1ac408eb1448b7207f2432b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:26.492300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:26.493097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16e1b13f1ac408eb1448b7207f2432b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:26.494489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16e1b13f1ac408eb1448b7207f2432b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:26.534121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1003/2035] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:26.534121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8d68c-0de1-428e-9694-61819de5db5a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:26.534121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-62b8d68c-0de1-428e-9694-61819de5db5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:26.553872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8d68c-0de1-428e-9694-61819de5db5a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:26.562118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d021d5-9658-4d01-b0ca-8b1e277c3420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:26.562877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d021d5-9658-4d01-b0ca-8b1e277c3420 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:26.563265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d021d5-9658-4d01-b0ca-8b1e277c3420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:26.564436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d021d5-9658-4d01-b0ca-8b1e277c3420 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.565352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d021d5-9658-4d01-b0ca-8b1e277c3420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:26.565850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d021d5-9658-4d01-b0ca-8b1e277c3420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:26.566817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1033/2036] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:26 2022] DELETE /identity/v3/users/b16e1b13f1ac408eb1448b7207f2432b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:26.568235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:26.568424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d021d5-9658-4d01-b0ca-8b1e277c3420 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:26.577013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:26.589908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1004/2037] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:26.592560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d021d5-9658-4d01-b0ca-8b1e277c3420 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:26.610266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d021d5-9658-4d01-b0ca-8b1e277c3420 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:26.737970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173694a-73e2-4628-9f19-3bb26b9e022a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:26.744482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0606ffc-b5be-4f03-afed-d41e873b0b13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a911a544e17e4fafb579da66973c431f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:26.745263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606ffc-b5be-4f03-afed-d41e873b0b13 service glance] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:26.745561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606ffc-b5be-4f03-afed-d41e873b0b13 service glance] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:26.745836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606ffc-b5be-4f03-afed-d41e873b0b13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.748259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c0606ffc-b5be-4f03-afed-d41e873b0b13 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:26.764589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1e1fc-57de-48e6-bc18-213a06b0ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:26.765516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e1fc-57de-48e6-bc18-213a06b0ca4f admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:26.770199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e1fc-57de-48e6-bc18-213a06b0ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:26.770199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e1fc-57de-48e6-bc18-213a06b0ca4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.770199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1e1fc-57de-48e6-bc18-213a06b0ca4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:26.770199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1e1fc-57de-48e6-bc18-213a06b0ca4f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:26.849482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0606ffc-b5be-4f03-afed-d41e873b0b13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:26.851296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0606ffc-b5be-4f03-afed-d41e873b0b13 service glance] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:26.871211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1034/2038] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:26.904373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1005/2039] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:26 2022] POST /identity/v3/projects => generated 385 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:26.908103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0606ffc-b5be-4f03-afed-d41e873b0b13 service glance] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:26.922950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0606ffc-b5be-4f03-afed-d41e873b0b13 service glance] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:26.941185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:26.948747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1e1fc-57de-48e6-bc18-213a06b0ca4f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:26.951023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-60d1e1fc-57de-48e6-bc18-213a06b0ca4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:27.028814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:27.054869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1e1fc-57de-48e6-bc18-213a06b0ca4f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:27.057043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae635c-67d2-4c1c-a81b-8260b317f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:27.058077 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae635c-67d2-4c1c-a81b-8260b317f11d admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.058618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae635c-67d2-4c1c-a81b-8260b317f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.059328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae635c-67d2-4c1c-a81b-8260b317f11d admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.060290 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae635c-67d2-4c1c-a81b-8260b317f11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:27.062714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:27.063424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.064353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.064567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] PATH_INFO: `/v3/projects/435250827333420f9884d5414ba9ca45` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.065378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae635c-67d2-4c1c-a81b-8260b317f11d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:27.066196 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435250827333420f9884d5414ba9ca45)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:27.068230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:27.168065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1035/2040] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:26 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:27.169890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae635c-67d2-4c1c-a81b-8260b317f11d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:27.172734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0cae635c-67d2-4c1c-a81b-8260b317f11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:27.191084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae635c-67d2-4c1c-a81b-8260b317f11d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:27.211094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435250827333420f9884d5414ba9ca45', 'request_id': 'req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:27.226711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435250827333420f9884d5414ba9ca45', 'request_id': 'req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:27.269560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:27.270467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.270682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.270957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] PATH_INFO: `/v3/projects/b174270a3714432f9fa00d47c08dc5d7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.272214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b174270a3714432f9fa00d47c08dc5d7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:27.274316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:27.315557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435250827333420f9884d5414ba9ca45', 'request_id': 'req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:27.328218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] The token cache is being invalidate because project 435250827333420f9884d5414ba9ca45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:27.341690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:27.342696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:27.344411 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1006/2041] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:26 2022] DELETE /identity/v3/projects/435250827333420f9884d5414ba9ca45 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:27.348678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:27.350181 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:27.364565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ce3ca-7e1a-43a2-b1a6-ef800708b8c1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:27.369434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0414d1-592c-4d2d-824e-c66fba44ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:27.370623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0414d1-592c-4d2d-824e-c66fba44ac77 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.370623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0414d1-592c-4d2d-824e-c66fba44ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.370623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0414d1-592c-4d2d-824e-c66fba44ac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.371289 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0414d1-592c-4d2d-824e-c66fba44ac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:27.373292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0414d1-592c-4d2d-824e-c66fba44ac77 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:27.399388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1007/2042] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:27.402522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac8d45-4524-4ed1-9d7e-a6b1af2d3d9e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.402685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac8d45-4524-4ed1-9d7e-a6b1af2d3d9e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.402942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac8d45-4524-4ed1-9d7e-a6b1af2d3d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.406882 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b174270a3714432f9fa00d47c08dc5d7', 'request_id': 'req-a053e97f-747d-450c-b9f8-19de56d02a8d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:27.425191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b174270a3714432f9fa00d47c08dc5d7', 'request_id': 'req-a053e97f-747d-450c-b9f8-19de56d02a8d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:27.428271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-99ac8d45-4524-4ed1-9d7e-a6b1af2d3d9e None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:27.429708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-99ac8d45-4524-4ed1-9d7e-a6b1af2d3d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:27.432902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b174270a3714432f9fa00d47c08dc5d7', 'request_id': 'req-a053e97f-747d-450c-b9f8-19de56d02a8d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:27.512614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1008/2043] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:05:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:27.514050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d72f0c-9893-4607-a42f-3cd949c0557a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.514334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d72f0c-9893-4607-a42f-3cd949c0557a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.514608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d72f0c-9893-4607-a42f-3cd949c0557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.535380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] The token cache is being invalidate because project b174270a3714432f9fa00d47c08dc5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:27.535726 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:27.539010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:27.541230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1036/2044] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:27 2022] DELETE /identity/v3/projects/b174270a3714432f9fa00d47c08dc5d7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:27.541962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:27.546330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:27.551459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-28d72f0c-9893-4607-a42f-3cd949c0557a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:27.553421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-28d72f0c-9893-4607-a42f-3cd949c0557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:27.646078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1009/2045] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:27.646286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053e97f-747d-450c-b9f8-19de56d02a8d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:27.646414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43271777-ab33-4722-9c69-f8f5c6a9d3b2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.646414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43271777-ab33-4722-9c69-f8f5c6a9d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.646414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43271777-ab33-4722-9c69-f8f5c6a9d3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.646641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bacf3-b8b4-4493-8bc1-ca567c03dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:27.646641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bacf3-b8b4-4493-8bc1-ca567c03dcca admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.646641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bacf3-b8b4-4493-8bc1-ca567c03dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.646905 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bacf3-b8b4-4493-8bc1-ca567c03dcca admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.647389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bacf3-b8b4-4493-8bc1-ca567c03dcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:27.649000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bacf3-b8b4-4493-8bc1-ca567c03dcca admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:27.666017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1037/2046] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:27.667216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bacf3-b8b4-4493-8bc1-ca567c03dcca admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:27.667382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-43271777-ab33-4722-9c69-f8f5c6a9d3b2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:27.668765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-43271777-ab33-4722-9c69-f8f5c6a9d3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:27.668895 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f12bacf3-b8b4-4493-8bc1-ca567c03dcca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:27.677943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1010/2047] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:27.679523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1616d7-de3b-4953-a354-327c7f5d1cbe None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.679823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1616d7-de3b-4953-a354-327c7f5d1cbe None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.680083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1616d7-de3b-4953-a354-327c7f5d1cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.703898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3a1616d7-de3b-4953-a354-327c7f5d1cbe None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:27.705416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3a1616d7-de3b-4953-a354-327c7f5d1cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:27.722284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1011/2048] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:27.724299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1616d7-de3b-4953-a354-327c7f5d1cbe None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:27.733198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:27.754913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1616d7-de3b-4953-a354-327c7f5d1cbe None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:27.768795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76ec3-c025-49e2-b081-6d99e70b9555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:27.771049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76ec3-c025-49e2-b081-6d99e70b9555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.771359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76ec3-c025-49e2-b081-6d99e70b9555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.771712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76ec3-c025-49e2-b081-6d99e70b9555 admin admin] PATH_INFO: `/v3/projects/0cbb7a347dab48cca12193330381e0cf/users/85de091343cc45f9a6989001ef8128d2/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.776749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bacf3-b8b4-4493-8bc1-ca567c03dcca admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:27.783828 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51b465-eca0-4e3e-a041-f688d405804d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:27.784641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51b465-eca0-4e3e-a041-f688d405804d service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.785131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51b465-eca0-4e3e-a041-f688d405804d service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.785809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51b465-eca0-4e3e-a041-f688d405804d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.792561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cc51b465-eca0-4e3e-a041-f688d405804d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:27.803441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76ec3-c025-49e2-b081-6d99e70b9555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbb7a347dab48cca12193330381e0cf, user_id=85de091343cc45f9a6989001ef8128d2, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:27.807806 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51b465-eca0-4e3e-a041-f688d405804d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:27.807940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76ec3-c025-49e2-b081-6d99e70b9555 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:27.809846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51b465-eca0-4e3e-a041-f688d405804d service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:27.822364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1038/2049] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:05:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:05:27.872734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45bca1-d70a-47f2-a9c1-0c74734bbae2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:27.878912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45bca1-d70a-47f2-a9c1-0c74734bbae2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:27.879224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45bca1-d70a-47f2-a9c1-0c74734bbae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:27.887273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1012/2050] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:27 2022] PUT /identity/v3/projects/0cbb7a347dab48cca12193330381e0cf/users/85de091343cc45f9a6989001ef8128d2/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:27.888701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76ec3-c025-49e2-b081-6d99e70b9555 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:28.001599 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3b45bca1-d70a-47f2-a9c1-0c74734bbae2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:28.002980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3b45bca1-d70a-47f2-a9c1-0c74734bbae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:28.053546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76ec3-c025-49e2-b081-6d99e70b9555 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:28.068994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1039/2051] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:28.075409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44234704-85c4-45e0-8b16-96fa9e12cf01 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.075409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44234704-85c4-45e0-8b16-96fa9e12cf01 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.075409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44234704-85c4-45e0-8b16-96fa9e12cf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.084793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53c7a-23fc-4c96-b91f-5696d338366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:28.089276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53c7a-23fc-4c96-b91f-5696d338366a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.094822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53c7a-23fc-4c96-b91f-5696d338366a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.094822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53c7a-23fc-4c96-b91f-5696d338366a admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.095429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c53c7a-23fc-4c96-b91f-5696d338366a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:28.095894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c53c7a-23fc-4c96-b91f-5696d338366a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:28.097801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c53c7a-23fc-4c96-b91f-5696d338366a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:28.106706 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:28.116433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1013/2052] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:28.117631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53c7a-23fc-4c96-b91f-5696d338366a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:28.134888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53c7a-23fc-4c96-b91f-5696d338366a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:28.151186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a874ef-c00d-4d4f-b82f-2cca90754325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:28.155646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a874ef-c00d-4d4f-b82f-2cca90754325 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.156297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a874ef-c00d-4d4f-b82f-2cca90754325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.156724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a874ef-c00d-4d4f-b82f-2cca90754325 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.157717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a874ef-c00d-4d4f-b82f-2cca90754325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:28.158352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a874ef-c00d-4d4f-b82f-2cca90754325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:28.161924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a874ef-c00d-4d4f-b82f-2cca90754325 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:28.169755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-44234704-85c4-45e0-8b16-96fa9e12cf01 None None] MFA Rules not processed for user `85de091343cc45f9a6989001ef8128d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:28.171423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-44234704-85c4-45e0-8b16-96fa9e12cf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:28.187272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1014/2053] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:28.188446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a874ef-c00d-4d4f-b82f-2cca90754325 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:28.227382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a874ef-c00d-4d4f-b82f-2cca90754325 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:28.243202 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01404ca6-2c94-406d-8803-6a436b25985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:28.246761 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404ca6-2c94-406d-8803-6a436b25985b admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.248034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404ca6-2c94-406d-8803-6a436b25985b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.251274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404ca6-2c94-406d-8803-6a436b25985b admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.253482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01404ca6-2c94-406d-8803-6a436b25985b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:28.261182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01404ca6-2c94-406d-8803-6a436b25985b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:28.373832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1040/2054] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:28.373832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44234704-85c4-45e0-8b16-96fa9e12cf01 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:28.387986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44234704-85c4-45e0-8b16-96fa9e12cf01 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:28.398843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b7e2c-6f68-4483-88f5-6562c9b99f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:28.399835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b7e2c-6f68-4483-88f5-6562c9b99f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.400228 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b7e2c-6f68-4483-88f5-6562c9b99f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.400670 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b7e2c-6f68-4483-88f5-6562c9b99f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.401503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b7e2c-6f68-4483-88f5-6562c9b99f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:28.410007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b7e2c-6f68-4483-88f5-6562c9b99f18 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:28.422057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1015/2055] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:28 2022] POST /identity/v3/projects => generated 371 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:28.422947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01404ca6-2c94-406d-8803-6a436b25985b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:28.555302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01404ca6-2c94-406d-8803-6a436b25985b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:28.566956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1041/2056] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:28 2022] POST /identity/v3/projects => generated 389 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:28.567818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b7e2c-6f68-4483-88f5-6562c9b99f18 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:28.581210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bbf82-99c4-4687-94d5-5634ab770e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:28.582016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bbf82-99c4-4687-94d5-5634ab770e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.582299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bbf82-99c4-4687-94d5-5634ab770e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.582714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bbf82-99c4-4687-94d5-5634ab770e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.583255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bbf82-99c4-4687-94d5-5634ab770e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:28.585751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bbf82-99c4-4687-94d5-5634ab770e8f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:28.665743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:28.704646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1016/2057] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:28 2022] POST /identity/v3/projects => generated 387 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:28.705703 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bbf82-99c4-4687-94d5-5634ab770e8f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:28.795938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b7e2c-6f68-4483-88f5-6562c9b99f18 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:28.885365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bbf82-99c4-4687-94d5-5634ab770e8f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:28.903082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ad87-3cb3-460c-8c3d-fefe64c0bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:28.903897 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ad87-3cb3-460c-8c3d-fefe64c0bc00 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.905571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ad87-3cb3-460c-8c3d-fefe64c0bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.905913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ad87-3cb3-460c-8c3d-fefe64c0bc00 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.907426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76ad87-3cb3-460c-8c3d-fefe64c0bc00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:28.914463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76ad87-3cb3-460c-8c3d-fefe64c0bc00 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:28.943827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ac745-f935-44b0-aa72-eae8aeb17303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:28.945237 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ac745-f935-44b0-aa72-eae8aeb17303 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.945484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ac745-f935-44b0-aa72-eae8aeb17303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.945897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ac745-f935-44b0-aa72-eae8aeb17303 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.947563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ac745-f935-44b0-aa72-eae8aeb17303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:28.949788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ac745-f935-44b0-aa72-eae8aeb17303 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:28.956264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:29.021693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1017/2058] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:28 2022] POST /identity/v3/users => generated 295 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:29.022593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ad87-3cb3-460c-8c3d-fefe64c0bc00 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.040638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ad87-3cb3-460c-8c3d-fefe64c0bc00 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.047082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d8dc-bcb9-4267-bacb-fd45405634eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.047781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d8dc-bcb9-4267-bacb-fd45405634eb admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.053073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d8dc-bcb9-4267-bacb-fd45405634eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.053073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d8dc-bcb9-4267-bacb-fd45405634eb admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.053073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138d8dc-bcb9-4267-bacb-fd45405634eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.053073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138d8dc-bcb9-4267-bacb-fd45405634eb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.083702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1042/2059] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:28 2022] POST /identity/v3/users => generated 286 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:29.083702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ac745-f935-44b0-aa72-eae8aeb17303 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.109270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ac745-f935-44b0-aa72-eae8aeb17303 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.128470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d5f4f-5632-43cd-85cd-8222093e700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.129574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d5f4f-5632-43cd-85cd-8222093e700b admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.130038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d5f4f-5632-43cd-85cd-8222093e700b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.130521 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d5f4f-5632-43cd-85cd-8222093e700b admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.131575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d5f4f-5632-43cd-85cd-8222093e700b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.136211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d5f4f-5632-43cd-85cd-8222093e700b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.180421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1018/2060] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:29 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:29.182255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d8dc-bcb9-4267-bacb-fd45405634eb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.213630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1043/2061] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:29.214662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d5f4f-5632-43cd-85cd-8222093e700b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.226088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d8dc-bcb9-4267-bacb-fd45405634eb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.239490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d5f4f-5632-43cd-85cd-8222093e700b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.243899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57013ff-5f83-472f-ad3e-ebf9ee872c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.243899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57013ff-5f83-472f-ad3e-ebf9ee872c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.243899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57013ff-5f83-472f-ad3e-ebf9ee872c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.243899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57013ff-5f83-472f-ad3e-ebf9ee872c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.244618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57013ff-5f83-472f-ad3e-ebf9ee872c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.246843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5253c-9ae1-42d9-a343-91f527d4a9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.250106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5253c-9ae1-42d9-a343-91f527d4a9ee admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.250331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57013ff-5f83-472f-ad3e-ebf9ee872c41 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.250896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5253c-9ae1-42d9-a343-91f527d4a9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.251725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5253c-9ae1-42d9-a343-91f527d4a9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.252789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5253c-9ae1-42d9-a343-91f527d4a9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.254926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5253c-9ae1-42d9-a343-91f527d4a9ee admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.271058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1044/2062] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:29.277876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5253c-9ae1-42d9-a343-91f527d4a9ee admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.288896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5253c-9ae1-42d9-a343-91f527d4a9ee admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.290490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1019/2063] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:29.292370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57013ff-5f83-472f-ad3e-ebf9ee872c41 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.297960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d156e-3b27-4825-b7ac-f0157be5ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.299518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d156e-3b27-4825-b7ac-f0157be5ed47 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.299949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d156e-3b27-4825-b7ac-f0157be5ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.302709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d156e-3b27-4825-b7ac-f0157be5ed47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.304296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d156e-3b27-4825-b7ac-f0157be5ed47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.306832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d156e-3b27-4825-b7ac-f0157be5ed47 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.317869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57013ff-5f83-472f-ad3e-ebf9ee872c41 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.530480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e01dda-0d6c-4f5f-948b-b85171c37cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.530480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01dda-0d6c-4f5f-948b-b85171c37cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.530480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01dda-0d6c-4f5f-948b-b85171c37cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.530480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01dda-0d6c-4f5f-948b-b85171c37cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.531235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e01dda-0d6c-4f5f-948b-b85171c37cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.531235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e01dda-0d6c-4f5f-948b-b85171c37cd7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.531750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1045/2064] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:29.531750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d156e-3b27-4825-b7ac-f0157be5ed47 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.531750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d156e-3b27-4825-b7ac-f0157be5ed47 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.532116 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1020/2065] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:29.532657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522be14-d1ab-4e51-9e97-a5d441eb6e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.532657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522be14-d1ab-4e51-9e97-a5d441eb6e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.532657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522be14-d1ab-4e51-9e97-a5d441eb6e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.532657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522be14-d1ab-4e51-9e97-a5d441eb6e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.533644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522be14-d1ab-4e51-9e97-a5d441eb6e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.533644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522be14-d1ab-4e51-9e97-a5d441eb6e05 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.533644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1046/2066] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:29.533900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e01dda-0d6c-4f5f-948b-b85171c37cd7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.533991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522be14-d1ab-4e51-9e97-a5d441eb6e05 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.544399 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e01dda-0d6c-4f5f-948b-b85171c37cd7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.547318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522be14-d1ab-4e51-9e97-a5d441eb6e05 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.555769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25171e-66f1-4abf-8e96-718c5e3ec24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.566817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25171e-66f1-4abf-8e96-718c5e3ec24d admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.566817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25171e-66f1-4abf-8e96-718c5e3ec24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.566817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25171e-66f1-4abf-8e96-718c5e3ec24d admin admin] PATH_INFO: `/v3/projects/8ffcaf094b7c4b8dbfb45b73083f0a3f/users/3b406e024d664e8a90632ca9bdf74c4f/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.567177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000fe31-3309-49e2-bf0d-82f044c06066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.567177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000fe31-3309-49e2-bf0d-82f044c06066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.567177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000fe31-3309-49e2-bf0d-82f044c06066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.567177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000fe31-3309-49e2-bf0d-82f044c06066 admin admin] PATH_INFO: `/v3/projects/1162e97719fc4ff5b2f82b369ba2dd4c/users/6ee3fd21f2de4d29ac900ef4cd17ccb3/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.592995 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000fe31-3309-49e2-bf0d-82f044c06066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1162e97719fc4ff5b2f82b369ba2dd4c, user_id=6ee3fd21f2de4d29ac900ef4cd17ccb3, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.593972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25171e-66f1-4abf-8e96-718c5e3ec24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffcaf094b7c4b8dbfb45b73083f0a3f, user_id=3b406e024d664e8a90632ca9bdf74c4f, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.610052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25171e-66f1-4abf-8e96-718c5e3ec24d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.610241 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000fe31-3309-49e2-bf0d-82f044c06066 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.846715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1021/2067] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:29 2022] PUT /identity/v3/projects/1162e97719fc4ff5b2f82b369ba2dd4c/users/6ee3fd21f2de4d29ac900ef4cd17ccb3/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:29.847612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000fe31-3309-49e2-bf0d-82f044c06066 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.859251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1047/2068] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:29 2022] PUT /identity/v3/projects/8ffcaf094b7c4b8dbfb45b73083f0a3f/users/3b406e024d664e8a90632ca9bdf74c4f/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:29.859251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64b6b-a587-40a8-a98c-67fcf793adde None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.859251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64b6b-a587-40a8-a98c-67fcf793adde None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.859251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64b6b-a587-40a8-a98c-67fcf793adde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.928529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3ad64b6b-a587-40a8-a98c-67fcf793adde None None] MFA Rules not processed for user `6ee3fd21f2de4d29ac900ef4cd17ccb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:29.930683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3ad64b6b-a587-40a8-a98c-67fcf793adde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:30.002164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000fe31-3309-49e2-bf0d-82f044c06066 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:30.013694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc2bee-326f-4617-9195-de6fb429c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:30.014767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2bee-326f-4617-9195-de6fb429c8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:30.015202 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2bee-326f-4617-9195-de6fb429c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:30.015638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2bee-326f-4617-9195-de6fb429c8f1 admin admin] PATH_INFO: `/v3/projects/a8d5185464a44efd9ce96a4a2e5e1ebd/users/456bce61404d4b9f9af5eb8328973a58/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:30.045934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1048/2069] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:30.047954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00586ed-6886-481e-a20d-1d2ab5bd2e2f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:30.047954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00586ed-6886-481e-a20d-1d2ab5bd2e2f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:30.048503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00586ed-6886-481e-a20d-1d2ab5bd2e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:30.094359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc2bee-326f-4617-9195-de6fb429c8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d5185464a44efd9ce96a4a2e5e1ebd, user_id=456bce61404d4b9f9af5eb8328973a58, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:30.098617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc2bee-326f-4617-9195-de6fb429c8f1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:30.107131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:30.109861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b00586ed-6886-481e-a20d-1d2ab5bd2e2f None None] MFA Rules not processed for user `3b406e024d664e8a90632ca9bdf74c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:30.111515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b00586ed-6886-481e-a20d-1d2ab5bd2e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:30.213459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1022/2070] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:29 2022] PUT /identity/v3/projects/a8d5185464a44efd9ce96a4a2e5e1ebd/users/456bce61404d4b9f9af5eb8328973a58/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:30.215024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc2bee-326f-4617-9195-de6fb429c8f1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:30.217967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5dcc2bee-326f-4617-9195-de6fb429c8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:30.292337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1049/2071] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:30.307658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24ddb-9240-45ef-ae2a-c37158f23672 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:30.308562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24ddb-9240-45ef-ae2a-c37158f23672 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:30.308951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24ddb-9240-45ef-ae2a-c37158f23672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:30.460537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc2bee-326f-4617-9195-de6fb429c8f1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:30.479894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1ca24ddb-9240-45ef-ae2a-c37158f23672 None None] MFA Rules not processed for user `456bce61404d4b9f9af5eb8328973a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:30.498023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd862a-d359-4a54-b641-e8ef90be920c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:30.498668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd862a-d359-4a54-b641-e8ef90be920c service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:30.498946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd862a-d359-4a54-b641-e8ef90be920c service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:30.499224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd862a-d359-4a54-b641-e8ef90be920c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:30.504256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1ca24ddb-9240-45ef-ae2a-c37158f23672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:30.506937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:30.649080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:30.686598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd862a-d359-4a54-b641-e8ef90be920c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:30.690941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd862a-d359-4a54-b641-e8ef90be920c service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:30.705355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1023/2072] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:30.706328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd862a-d359-4a54-b641-e8ef90be920c service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:30.756364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1050/2073] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:30.757245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24ddb-9240-45ef-ae2a-c37158f23672 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:30.840524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd862a-d359-4a54-b641-e8ef90be920c service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:30.865506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a0a91-deb6-4182-b1ba-35028fde96e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:30.866150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a0a91-deb6-4182-b1ba-35028fde96e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:30.866417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a0a91-deb6-4182-b1ba-35028fde96e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:30.866694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a0a91-deb6-4182-b1ba-35028fde96e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:30.867372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a0a91-deb6-4182-b1ba-35028fde96e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:30.870121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a0a91-deb6-4182-b1ba-35028fde96e6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:30.894683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24ddb-9240-45ef-ae2a-c37158f23672 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:30.905725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:30.906966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:30.906966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:30.906966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] PATH_INFO: `/v3/users/6ee3fd21f2de4d29ac900ef4cd17ccb3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:30.908155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee3fd21f2de4d29ac900ef4cd17ccb3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:30.916797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:30.952603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:30.964276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1024/2074] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:30 2022] POST /identity/v3/projects => generated 387 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:30.965239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a0a91-deb6-4182-b1ba-35028fde96e6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:30.992010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:31.113101 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a0a91-deb6-4182-b1ba-35028fde96e6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:31.119348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af4bb-9343-49ec-9e75-d036070935fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:31.120089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af4bb-9343-49ec-9e75-d036070935fc admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.120373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af4bb-9343-49ec-9e75-d036070935fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.120651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af4bb-9343-49ec-9e75-d036070935fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.121819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60af4bb-9343-49ec-9e75-d036070935fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:31.123785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60af4bb-9343-49ec-9e75-d036070935fc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:31.210863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee3fd21f2de4d29ac900ef4cd17ccb3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:31.219455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee3fd21f2de4d29ac900ef4cd17ccb3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:31.226400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1025/2075] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:30 2022] POST /identity/v3/projects => generated 391 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:31.227581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af4bb-9343-49ec-9e75-d036070935fc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:31.312713 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af4bb-9343-49ec-9e75-d036070935fc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:31.317704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18b201-35aa-4209-9ee5-39d608e71116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:31.318334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18b201-35aa-4209-9ee5-39d608e71116 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.318664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18b201-35aa-4209-9ee5-39d608e71116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.318940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18b201-35aa-4209-9ee5-39d608e71116 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.319604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18b201-35aa-4209-9ee5-39d608e71116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:31.322292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18b201-35aa-4209-9ee5-39d608e71116 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:31.335428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee3fd21f2de4d29ac900ef4cd17ccb3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:31.336739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee3fd21f2de4d29ac900ef4cd17ccb3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:31.338139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee3fd21f2de4d29ac900ef4cd17ccb3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:31.371734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1051/2076] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:30 2022] DELETE /identity/v3/users/6ee3fd21f2de4d29ac900ef4cd17ccb3 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:31.371734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:31.371734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:31.529400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:31.567335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1026/2077] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:31 2022] POST /identity/v3/users => generated 300 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:31.567335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aec862-91d2-4353-bd43-f529e5951cb0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.567335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aec862-91d2-4353-bd43-f529e5951cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.567335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aec862-91d2-4353-bd43-f529e5951cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.581444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:31.601677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f2aec862-91d2-4353-bd43-f529e5951cb0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:31.603987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f2aec862-91d2-4353-bd43-f529e5951cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:31.632255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1027/2078] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:31.633465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aec862-91d2-4353-bd43-f529e5951cb0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:31.635925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f2aec862-91d2-4353-bd43-f529e5951cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:31.644518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdc689-887f-46cd-80df-fcbd6d0df7ad admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:31.653477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aec862-91d2-4353-bd43-f529e5951cb0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:31.654961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd1e0a-e384-4c1d-badd-afcfe9a74560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:31.656650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd1e0a-e384-4c1d-badd-afcfe9a74560 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.656956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd1e0a-e384-4c1d-badd-afcfe9a74560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.657707 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd1e0a-e384-4c1d-badd-afcfe9a74560 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.659605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd1e0a-e384-4c1d-badd-afcfe9a74560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:31.660556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cda1b0-e208-4466-9b66-6ea2a9b7de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:31.661348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cda1b0-e208-4466-9b66-6ea2a9b7de92 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.661730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cda1b0-e208-4466-9b66-6ea2a9b7de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.662102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cda1b0-e208-4466-9b66-6ea2a9b7de92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.662533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd1e0a-e384-4c1d-badd-afcfe9a74560 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:31.663898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cda1b0-e208-4466-9b66-6ea2a9b7de92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:31.669082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cda1b0-e208-4466-9b66-6ea2a9b7de92 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:31.681922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1028/2079] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:31.686347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cda1b0-e208-4466-9b66-6ea2a9b7de92 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:31.688433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e1cda1b0-e208-4466-9b66-6ea2a9b7de92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:31.697798 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:31.768871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cda1b0-e208-4466-9b66-6ea2a9b7de92 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:31.776284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4d4f-6568-4cfa-a63f-ec9788d7aced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:31.779434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4d4f-6568-4cfa-a63f-ec9788d7aced service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.779650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4d4f-6568-4cfa-a63f-ec9788d7aced service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.782888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4d4f-6568-4cfa-a63f-ec9788d7aced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.789970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1052/2080] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:31 2022] POST /identity/v3/users => generated 302 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:31.794212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd1e0a-e384-4c1d-badd-afcfe9a74560 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:31.804995 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a4d4f-6568-4cfa-a63f-ec9788d7aced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:31.808185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a4d4f-6568-4cfa-a63f-ec9788d7aced service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:31.829596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd1e0a-e384-4c1d-badd-afcfe9a74560 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:31.835011 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1029/2081] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:31.835932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4d4f-6568-4cfa-a63f-ec9788d7aced service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:31.861684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4d4f-6568-4cfa-a63f-ec9788d7aced service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:31.871023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d48938-554b-4111-be2a-447e6dc2b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:31.871856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48938-554b-4111-be2a-447e6dc2b23c admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.872148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48938-554b-4111-be2a-447e6dc2b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.872425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48938-554b-4111-be2a-447e6dc2b23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.873222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69af13-ef48-46d0-877e-925f2cf9e6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:31.873364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d48938-554b-4111-be2a-447e6dc2b23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:31.873960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69af13-ef48-46d0-877e-925f2cf9e6e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.874253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69af13-ef48-46d0-877e-925f2cf9e6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.874542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69af13-ef48-46d0-877e-925f2cf9e6e1 admin admin] PATH_INFO: `/v3/projects/9a316a76d4d0410eaee0afefdcfcc090/users/71ad5464a69446008ebeb890db553cca/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.876148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d48938-554b-4111-be2a-447e6dc2b23c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:31.904105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1030/2082] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:31.908578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d48938-554b-4111-be2a-447e6dc2b23c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:31.917954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:31.922907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69af13-ef48-46d0-877e-925f2cf9e6e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a316a76d4d0410eaee0afefdcfcc090, user_id=71ad5464a69446008ebeb890db553cca, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:31.924373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69af13-ef48-46d0-877e-925f2cf9e6e1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:31.927161 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d48938-554b-4111-be2a-447e6dc2b23c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:31.943509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c90990-7184-47dd-8c30-e09a22ecb5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:31.944205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c90990-7184-47dd-8c30-e09a22ecb5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.944490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c90990-7184-47dd-8c30-e09a22ecb5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.944770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c90990-7184-47dd-8c30-e09a22ecb5c5 admin admin] PATH_INFO: `/v3/projects/ebc28ffad755490290ec1bce6d77918e/users/3ce5500d0e544e819dc6e8379f33af44/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.970788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c90990-7184-47dd-8c30-e09a22ecb5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc28ffad755490290ec1bce6d77918e, user_id=3ce5500d0e544e819dc6e8379f33af44, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:31.975027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c90990-7184-47dd-8c30-e09a22ecb5c5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:32.032687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:32.042380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1053/2083] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:31 2022] PUT /identity/v3/projects/9a316a76d4d0410eaee0afefdcfcc090/users/71ad5464a69446008ebeb890db553cca/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:32.044176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69af13-ef48-46d0-877e-925f2cf9e6e1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:32.098256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1031/2084] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:31 2022] PUT /identity/v3/projects/ebc28ffad755490290ec1bce6d77918e/users/3ce5500d0e544e819dc6e8379f33af44/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:32.103420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c90990-7184-47dd-8c30-e09a22ecb5c5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:32.248794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c90990-7184-47dd-8c30-e09a22ecb5c5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:32.255372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2329a09-5f33-47e4-826a-50a101580a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:32.256012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329a09-5f33-47e4-826a-50a101580a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:32.256298 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329a09-5f33-47e4-826a-50a101580a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:32.257038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329a09-5f33-47e4-826a-50a101580a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:32.257384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2329a09-5f33-47e4-826a-50a101580a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:32.260579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2329a09-5f33-47e4-826a-50a101580a66 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:32.273030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69af13-ef48-46d0-877e-925f2cf9e6e1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:32.291529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1032/2085] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:32.295756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2329a09-5f33-47e4-826a-50a101580a66 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:32.297766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2869076-e997-48de-b510-3bfd3a3b4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:32.299269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2869076-e997-48de-b510-3bfd3a3b4006 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:32.301770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:32.302272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2869076-e997-48de-b510-3bfd3a3b4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:32.302729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2869076-e997-48de-b510-3bfd3a3b4006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:32.306967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2869076-e997-48de-b510-3bfd3a3b4006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:32.313699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2869076-e997-48de-b510-3bfd3a3b4006 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:32.331440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2329a09-5f33-47e4-826a-50a101580a66 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:32.349528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3860c-ee2c-451b-9393-564536b66258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:32.350916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3860c-ee2c-451b-9393-564536b66258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:32.351208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3860c-ee2c-451b-9393-564536b66258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:32.351493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3860c-ee2c-451b-9393-564536b66258 admin admin] PATH_INFO: `/v3/projects/ebc28ffad755490290ec1bce6d77918e/users/3ce5500d0e544e819dc6e8379f33af44/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:32.355296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1054/2086] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:32.359438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3860c-ee2c-451b-9393-564536b66258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc28ffad755490290ec1bce6d77918e, user_id=3ce5500d0e544e819dc6e8379f33af44, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:32.359626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2869076-e997-48de-b510-3bfd3a3b4006 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:32.365177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3860c-ee2c-451b-9393-564536b66258 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:32.388234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2869076-e997-48de-b510-3bfd3a3b4006 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:32.392620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1033/2087] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:32 2022] PUT /identity/v3/projects/ebc28ffad755490290ec1bce6d77918e/users/3ce5500d0e544e819dc6e8379f33af44/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:32.394510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ee8b1-84dc-403a-9b58-076b94add0a8 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:32.395040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ee8b1-84dc-403a-9b58-076b94add0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:32.395606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ee8b1-84dc-403a-9b58-076b94add0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:32.434391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-225ee8b1-84dc-403a-9b58-076b94add0a8 None None] MFA Rules not processed for user `3ce5500d0e544e819dc6e8379f33af44`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:32.435969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-225ee8b1-84dc-403a-9b58-076b94add0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:32.540876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deca3c0-c3dd-4fbb-abf6-e09dff6938c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:32.542121 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deca3c0-c3dd-4fbb-abf6-e09dff6938c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:32.542436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deca3c0-c3dd-4fbb-abf6-e09dff6938c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:32.542724 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deca3c0-c3dd-4fbb-abf6-e09dff6938c9 admin admin] PATH_INFO: `/v3/projects/9a316a76d4d0410eaee0afefdcfcc090/users/71ad5464a69446008ebeb890db553cca/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:32.550037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deca3c0-c3dd-4fbb-abf6-e09dff6938c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a316a76d4d0410eaee0afefdcfcc090, user_id=71ad5464a69446008ebeb890db553cca, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:32.552752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deca3c0-c3dd-4fbb-abf6-e09dff6938c9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:32.575241 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1034/2088] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:32.582544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1055/2089] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:32 2022] PUT /identity/v3/projects/9a316a76d4d0410eaee0afefdcfcc090/users/71ad5464a69446008ebeb890db553cca/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:32.593730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ee8b1-84dc-403a-9b58-076b94add0a8 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:32.597871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-225ee8b1-84dc-403a-9b58-076b94add0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:32.604591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:32.609438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13cb32-5eab-4add-a467-bf0999b2dc4d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:32.609727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13cb32-5eab-4add-a467-bf0999b2dc4d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:32.610003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13cb32-5eab-4add-a467-bf0999b2dc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:32.671578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7a13cb32-5eab-4add-a467-bf0999b2dc4d None None] MFA Rules not processed for user `71ad5464a69446008ebeb890db553cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:32.674050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7a13cb32-5eab-4add-a467-bf0999b2dc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:32.688422 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:32.783715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ee8b1-84dc-403a-9b58-076b94add0a8 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:32.862696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4be92-b6bb-41ec-ab6b-0521c0a5c225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:32.863459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4be92-b6bb-41ec-ab6b-0521c0a5c225 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:32.863839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4be92-b6bb-41ec-ab6b-0521c0a5c225 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:32.864315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4be92-b6bb-41ec-ab6b-0521c0a5c225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:32.897322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1056/2090] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:32.906629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13cb32-5eab-4add-a467-bf0999b2dc4d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:32.908193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7a13cb32-5eab-4add-a467-bf0999b2dc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:32.931309 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13cb32-5eab-4add-a467-bf0999b2dc4d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:32.954872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c9b6f-b9b7-4ec5-8a28-06ef84129d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:32.954872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9b6f-b9b7-4ec5-8a28-06ef84129d4d service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:32.954872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9b6f-b9b7-4ec5-8a28-06ef84129d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:32.954872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9b6f-b9b7-4ec5-8a28-06ef84129d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:32.974808 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c9b6f-b9b7-4ec5-8a28-06ef84129d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:32.976438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c9b6f-b9b7-4ec5-8a28-06ef84129d4d service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:32.989555 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4be92-b6bb-41ec-ab6b-0521c0a5c225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:32.991569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4be92-b6bb-41ec-ab6b-0521c0a5c225 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:32.993297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1057/2091] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:05:33.008571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1035/2092] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:33.118475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4be92-b6bb-41ec-ab6b-0521c0a5c225 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:33.119215 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c9b6f-b9b7-4ec5-8a28-06ef84129d4d service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:33.124655 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6a5c9b6f-b9b7-4ec5-8a28-06ef84129d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:33.142092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:33.155622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4be92-b6bb-41ec-ab6b-0521c0a5c225 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:33.186521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1399e22-27e3-4f6d-85ef-eb50df7f70f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:33.192174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399e22-27e3-4f6d-85ef-eb50df7f70f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:33.192174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399e22-27e3-4f6d-85ef-eb50df7f70f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:33.192174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399e22-27e3-4f6d-85ef-eb50df7f70f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:33.200116 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c1399e22-27e3-4f6d-85ef-eb50df7f70f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:33.366025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1399e22-27e3-4f6d-85ef-eb50df7f70f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:33.369857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1399e22-27e3-4f6d-85ef-eb50df7f70f6 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:33.372124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c9b6f-b9b7-4ec5-8a28-06ef84129d4d service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:33.388562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:33.390126 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:33.393667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:33.394807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] PATH_INFO: `/v3/projects/1162e97719fc4ff5b2f82b369ba2dd4c` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:33.397937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1162e97719fc4ff5b2f82b369ba2dd4c)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:33.400902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1036/2093] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:33.403134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:33.693022 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1162e97719fc4ff5b2f82b369ba2dd4c', 'request_id': 'req-9cf6baab-26cb-479c-b05d-32eb7d858a07'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:33.749673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1162e97719fc4ff5b2f82b369ba2dd4c', 'request_id': 'req-9cf6baab-26cb-479c-b05d-32eb7d858a07'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:33.759679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1162e97719fc4ff5b2f82b369ba2dd4c', 'request_id': 'req-9cf6baab-26cb-479c-b05d-32eb7d858a07'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:34.073509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] The token cache is being invalidate because project 1162e97719fc4ff5b2f82b369ba2dd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:34.073866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:34.074602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9cf6baab-26cb-479c-b05d-32eb7d858a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:34.079982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1058/2094] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:33 2022] DELETE /identity/v3/projects/1162e97719fc4ff5b2f82b369ba2dd4c => generated 0 bytes in 960 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:34.080832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1399e22-27e3-4f6d-85ef-eb50df7f70f6 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.082114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474795c-8f26-481f-9e34-97040d9afba5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.082778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474795c-8f26-481f-9e34-97040d9afba5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.083140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474795c-8f26-481f-9e34-97040d9afba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.084378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c1399e22-27e3-4f6d-85ef-eb50df7f70f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:34.109249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6474795c-8f26-481f-9e34-97040d9afba5 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:34.111440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6474795c-8f26-481f-9e34-97040d9afba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:34.121195 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1399e22-27e3-4f6d-85ef-eb50df7f70f6 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:34.187688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:34.202159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1059/2095] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:34.204668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53897d-26af-4493-ac3b-0d1dd5819f11 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.205112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53897d-26af-4493-ac3b-0d1dd5819f11 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.205579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53897d-26af-4493-ac3b-0d1dd5819f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.230529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-dc53897d-26af-4493-ac3b-0d1dd5819f11 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:34.232101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-dc53897d-26af-4493-ac3b-0d1dd5819f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:34.247458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1060/2096] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:34.251881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53897d-26af-4493-ac3b-0d1dd5819f11 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.253640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:34.253640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.253640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.253640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] PATH_INFO: `/v3/users/20625ee0dcb0427183ad6f9865ff5764` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.255497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20625ee0dcb0427183ad6f9865ff5764)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:34.258824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:34.265341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53897d-26af-4493-ac3b-0d1dd5819f11 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:34.272372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806215-3e20-483c-945d-923d6a76f5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:34.273017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806215-3e20-483c-945d-923d6a76f5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.273765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806215-3e20-483c-945d-923d6a76f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.274050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806215-3e20-483c-945d-923d6a76f5a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.275914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc806215-3e20-483c-945d-923d6a76f5a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:34.276225 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc806215-3e20-483c-945d-923d6a76f5a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:34.290549 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc806215-3e20-483c-945d-923d6a76f5a5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:34.309157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1061/2097] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:05:34.318194 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806215-3e20-483c-945d-923d6a76f5a5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.330734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806215-3e20-483c-945d-923d6a76f5a5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:34.335864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3dd7-c6e1-47aa-8077-b04c988dc596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:34.336495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3dd7-c6e1-47aa-8077-b04c988dc596 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.336774 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3dd7-c6e1-47aa-8077-b04c988dc596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.337260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3dd7-c6e1-47aa-8077-b04c988dc596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.337962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe3dd7-c6e1-47aa-8077-b04c988dc596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:34.339891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe3dd7-c6e1-47aa-8077-b04c988dc596 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:34.352452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:34.472247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1062/2098] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:34 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:05:34.477234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3dd7-c6e1-47aa-8077-b04c988dc596 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.538536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20625ee0dcb0427183ad6f9865ff5764'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:34.543265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20625ee0dcb0427183ad6f9865ff5764'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:34.589611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3dd7-c6e1-47aa-8077-b04c988dc596 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:34.604474 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c508-3112-41df-b353-a804fd0e8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:34.616427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c508-3112-41df-b353-a804fd0e8e81 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.616427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c508-3112-41df-b353-a804fd0e8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.616427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c508-3112-41df-b353-a804fd0e8e81 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.616427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853c508-3112-41df-b353-a804fd0e8e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:34.616427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853c508-3112-41df-b353-a804fd0e8e81 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:34.638594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20625ee0dcb0427183ad6f9865ff5764'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:34.673971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20625ee0dcb0427183ad6f9865ff5764'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:34.691600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20625ee0dcb0427183ad6f9865ff5764'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:34.721316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1063/2099] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:34 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:05:34.721316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c508-3112-41df-b353-a804fd0e8e81 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.726121 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9853c508-3112-41df-b353-a804fd0e8e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:34.727198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1037/2100] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:34 2022] DELETE /identity/v3/users/20625ee0dcb0427183ad6f9865ff5764 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:34.754844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c508-3112-41df-b353-a804fd0e8e81 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:34.883940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd6993-de71-4de1-a111-a19a0831bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:34.887248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6993-de71-4de1-a111-a19a0831bf9c admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.887711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6993-de71-4de1-a111-a19a0831bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.888208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6993-de71-4de1-a111-a19a0831bf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.889939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd6993-de71-4de1-a111-a19a0831bf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:34.894285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd6993-de71-4de1-a111-a19a0831bf9c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:34.914422 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1064/2101] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:34.935102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.935102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918dbeb-c840-4fd6-bcf4-ffb810ca3852 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:34.942157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a5167-b6fe-46a6-abef-79eee8cac585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:34.943063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5167-b6fe-46a6-abef-79eee8cac585 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.944126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5167-b6fe-46a6-abef-79eee8cac585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.944600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5167-b6fe-46a6-abef-79eee8cac585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.947334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a5167-b6fe-46a6-abef-79eee8cac585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:34.949885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a5167-b6fe-46a6-abef-79eee8cac585 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:34.951607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd6993-de71-4de1-a111-a19a0831bf9c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.953662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-73bd6993-de71-4de1-a111-a19a0831bf9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:34.971264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1038/2102] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:34.978568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a5167-b6fe-46a6-abef-79eee8cac585 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:35.006442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a5167-b6fe-46a6-abef-79eee8cac585 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:35.012898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906943b9-2d0e-40ca-b114-25d26417180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:35.015341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906943b9-2d0e-40ca-b114-25d26417180a admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.015341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906943b9-2d0e-40ca-b114-25d26417180a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.015341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906943b9-2d0e-40ca-b114-25d26417180a admin admin] PATH_INFO: `/v3/projects/4ccf6fa240434e8bb4957bc879a7127e/users/7439b689bf91437988a785f79a924720/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.030909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd6993-de71-4de1-a111-a19a0831bf9c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:35.035434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506755e7-8cd4-4961-8785-405fea22d0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:35.036145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506755e7-8cd4-4961-8785-405fea22d0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.036438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506755e7-8cd4-4961-8785-405fea22d0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.038361 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506755e7-8cd4-4961-8785-405fea22d0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.038994 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-506755e7-8cd4-4961-8785-405fea22d0c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:35.044200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906943b9-2d0e-40ca-b114-25d26417180a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccf6fa240434e8bb4957bc879a7127e, user_id=7439b689bf91437988a785f79a924720, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:35.047425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906943b9-2d0e-40ca-b114-25d26417180a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:35.075036 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:35.127874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1039/2103] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:34 2022] PUT /identity/v3/projects/4ccf6fa240434e8bb4957bc879a7127e/users/7439b689bf91437988a785f79a924720/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:35.127874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906943b9-2d0e-40ca-b114-25d26417180a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:35.127874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-906943b9-2d0e-40ca-b114-25d26417180a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:35.132435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506755e7-8cd4-4961-8785-405fea22d0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:35.134388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506755e7-8cd4-4961-8785-405fea22d0c5 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:35.148673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1065/2104] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:05:35.153815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eafc9-53f6-4a80-beda-f5cfc66dcb72 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.153815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eafc9-53f6-4a80-beda-f5cfc66dcb72 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.153815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eafc9-53f6-4a80-beda-f5cfc66dcb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.190831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a52eafc9-53f6-4a80-beda-f5cfc66dcb72 None None] MFA Rules not processed for user `7439b689bf91437988a785f79a924720`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:35.194894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a52eafc9-53f6-4a80-beda-f5cfc66dcb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:35.231648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906943b9-2d0e-40ca-b114-25d26417180a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:35.243254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:35.243910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.244192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.244466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] PATH_INFO: `/v3/projects/e3154bd58b544d0d857e5b3918783cc9` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.247566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3154bd58b544d0d857e5b3918783cc9)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:35.249368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:35.265303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:35.328767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1066/2105] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:35.331491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eafc9-53f6-4a80-beda-f5cfc66dcb72 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:35.353613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eafc9-53f6-4a80-beda-f5cfc66dcb72 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:35.367555 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb51ea-8286-4660-abff-f6c27e405a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:35.370710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb51ea-8286-4660-abff-f6c27e405a18 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.373679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb51ea-8286-4660-abff-f6c27e405a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.373679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb51ea-8286-4660-abff-f6c27e405a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.373679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb51ea-8286-4660-abff-f6c27e405a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:35.377866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb51ea-8286-4660-abff-f6c27e405a18 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:35.398242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3154bd58b544d0d857e5b3918783cc9', 'request_id': 'req-e82c2361-834e-4b53-9e67-75f2429a87ac'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:35.409993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3154bd58b544d0d857e5b3918783cc9', 'request_id': 'req-e82c2361-834e-4b53-9e67-75f2429a87ac'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:35.505892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3154bd58b544d0d857e5b3918783cc9', 'request_id': 'req-e82c2361-834e-4b53-9e67-75f2429a87ac'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:35.525646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1067/2106] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:35 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:35.529769 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] The token cache is being invalidate because project e3154bd58b544d0d857e5b3918783cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:35.530265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb51ea-8286-4660-abff-f6c27e405a18 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:35.530399 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:35.531134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e82c2361-834e-4b53-9e67-75f2429a87ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:35.532946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1040/2107] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:35 2022] DELETE /identity/v3/projects/e3154bd58b544d0d857e5b3918783cc9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:35.534171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f1fb51ea-8286-4660-abff-f6c27e405a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:35.545402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729dd1-cb1a-4733-956b-5c131f87e705 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.545402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729dd1-cb1a-4733-956b-5c131f87e705 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.545700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729dd1-cb1a-4733-956b-5c131f87e705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.570346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c3729dd1-cb1a-4733-956b-5c131f87e705 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:35.572156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c3729dd1-cb1a-4733-956b-5c131f87e705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:35.689231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1041/2108] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:35.689231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7d5f6-85fa-4df9-aa8d-ddaaf4e8bf34 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.689231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7d5f6-85fa-4df9-aa8d-ddaaf4e8bf34 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.689231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7d5f6-85fa-4df9-aa8d-ddaaf4e8bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.692384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb51ea-8286-4660-abff-f6c27e405a18 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:35.704863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c82a7-9de4-4102-a0b6-e8b20f588fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:35.705795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c82a7-9de4-4102-a0b6-e8b20f588fff admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.706060 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c82a7-9de4-4102-a0b6-e8b20f588fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.706332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c82a7-9de4-4102-a0b6-e8b20f588fff admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.707052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c82a7-9de4-4102-a0b6-e8b20f588fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:35.709162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c82a7-9de4-4102-a0b6-e8b20f588fff admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:35.715458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4dd7d5f6-85fa-4df9-aa8d-ddaaf4e8bf34 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:35.717070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4dd7d5f6-85fa-4df9-aa8d-ddaaf4e8bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:35.728111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1042/2109] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:35.734118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7d5f6-85fa-4df9-aa8d-ddaaf4e8bf34 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:35.745924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7d5f6-85fa-4df9-aa8d-ddaaf4e8bf34 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:35.752495 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd11a9-1b55-4e0b-8a9c-41669b1dce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:35.753256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd11a9-1b55-4e0b-8a9c-41669b1dce9e admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.763188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd11a9-1b55-4e0b-8a9c-41669b1dce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.763188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd11a9-1b55-4e0b-8a9c-41669b1dce9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.763188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd11a9-1b55-4e0b-8a9c-41669b1dce9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:35.763188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd11a9-1b55-4e0b-8a9c-41669b1dce9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:35.763188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd11a9-1b55-4e0b-8a9c-41669b1dce9e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:35.773459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1043/2110] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:35.775737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd11a9-1b55-4e0b-8a9c-41669b1dce9e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:35.791733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd11a9-1b55-4e0b-8a9c-41669b1dce9e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:35.797427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6c0ef-1cd4-4879-9f72-d4bcd5eb91d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:35.798064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6c0ef-1cd4-4879-9f72-d4bcd5eb91d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.798348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6c0ef-1cd4-4879-9f72-d4bcd5eb91d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.798626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6c0ef-1cd4-4879-9f72-d4bcd5eb91d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.799372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6c0ef-1cd4-4879-9f72-d4bcd5eb91d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:35.801425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6c0ef-1cd4-4879-9f72-d4bcd5eb91d4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:35.823037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1068/2111] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:35 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:35.827231 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c82a7-9de4-4102-a0b6-e8b20f588fff admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:35.844776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c82a7-9de4-4102-a0b6-e8b20f588fff admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:35.849900 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0474456-6859-434f-b1ac-494064e2a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:35.850617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0474456-6859-434f-b1ac-494064e2a08b admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.850903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0474456-6859-434f-b1ac-494064e2a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.851179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0474456-6859-434f-b1ac-494064e2a08b admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.851962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0474456-6859-434f-b1ac-494064e2a08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:35.859019 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0474456-6859-434f-b1ac-494064e2a08b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:35.866299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1069/2112] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:35.870305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0474456-6859-434f-b1ac-494064e2a08b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:35.883210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0474456-6859-434f-b1ac-494064e2a08b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:35.889173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43e7c6-a60e-4be2-a8df-eddc878af210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:35.889861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43e7c6-a60e-4be2-a8df-eddc878af210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.890148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43e7c6-a60e-4be2-a8df-eddc878af210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.890481 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43e7c6-a60e-4be2-a8df-eddc878af210 admin admin] PATH_INFO: `/v3/projects/aa85f358c1454e5284057ed4877b4fef/users/83e8768ce38f4ab2ab5a9c1c962ef392/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.917966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1044/2113] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:35 2022] POST /identity/v3/projects => generated 389 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:35.919016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6c0ef-1cd4-4879-9f72-d4bcd5eb91d4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:35.919279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43e7c6-a60e-4be2-a8df-eddc878af210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa85f358c1454e5284057ed4877b4fef, user_id=83e8768ce38f4ab2ab5a9c1c962ef392, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:35.934100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43e7c6-a60e-4be2-a8df-eddc878af210 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:35.940189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:36.016873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1070/2114] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:35 2022] PUT /identity/v3/projects/aa85f358c1454e5284057ed4877b4fef/users/83e8768ce38f4ab2ab5a9c1c962ef392/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:36.020602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43e7c6-a60e-4be2-a8df-eddc878af210 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:36.038731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6c0ef-1cd4-4879-9f72-d4bcd5eb91d4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:36.052022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:36.148632 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5f739-0a72-4470-aac6-27be10df41ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:36.149375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5f739-0a72-4470-aac6-27be10df41ba admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:36.149714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5f739-0a72-4470-aac6-27be10df41ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:36.150000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5f739-0a72-4470-aac6-27be10df41ba admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:36.150927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5f739-0a72-4470-aac6-27be10df41ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:36.153233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5f739-0a72-4470-aac6-27be10df41ba admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:36.174277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43e7c6-a60e-4be2-a8df-eddc878af210 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:36.190557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e01c88-7d7e-4ab4-8fd4-e898c6a060b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:36.192019 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01c88-7d7e-4ab4-8fd4-e898c6a060b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:36.193035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01c88-7d7e-4ab4-8fd4-e898c6a060b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:36.193576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01c88-7d7e-4ab4-8fd4-e898c6a060b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:36.194578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e01c88-7d7e-4ab4-8fd4-e898c6a060b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:36.201548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e01c88-7d7e-4ab4-8fd4-e898c6a060b6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:36.222751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1071/2115] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:36.226716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e01c88-7d7e-4ab4-8fd4-e898c6a060b6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:36.241368 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e01c88-7d7e-4ab4-8fd4-e898c6a060b6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:36.248804 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434a059-2a6e-48a5-9f29-344b74e0facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:36.253229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a059-2a6e-48a5-9f29-344b74e0facb admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:36.253229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a059-2a6e-48a5-9f29-344b74e0facb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:36.253229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a059-2a6e-48a5-9f29-344b74e0facb admin admin] PATH_INFO: `/v3/projects/aa85f358c1454e5284057ed4877b4fef/users/83e8768ce38f4ab2ab5a9c1c962ef392/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:36.253229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434a059-2a6e-48a5-9f29-344b74e0facb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa85f358c1454e5284057ed4877b4fef, user_id=83e8768ce38f4ab2ab5a9c1c962ef392, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:36.254850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434a059-2a6e-48a5-9f29-344b74e0facb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:36.268199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1072/2116] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:36 2022] PUT /identity/v3/projects/aa85f358c1454e5284057ed4877b4fef/users/83e8768ce38f4ab2ab5a9c1c962ef392/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:36.280037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fb251-36ae-40f7-ab05-c66378dc0b2e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:36.280557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fb251-36ae-40f7-ab05-c66378dc0b2e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:36.281204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fb251-36ae-40f7-ab05-c66378dc0b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:36.289182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1045/2117] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:35 2022] POST /identity/v3/users => generated 295 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:36.294313 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5f739-0a72-4470-aac6-27be10df41ba admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:36.305295 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5f739-0a72-4470-aac6-27be10df41ba admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:36.322914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0a8fb251-36ae-40f7-ab05-c66378dc0b2e None None] MFA Rules not processed for user `83e8768ce38f4ab2ab5a9c1c962ef392`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:36.327849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0a8fb251-36ae-40f7-ab05-c66378dc0b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:36.412810 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e68b-6d7b-4612-a92f-9e93cb8ea93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:36.413868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e68b-6d7b-4612-a92f-9e93cb8ea93f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:36.413983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e68b-6d7b-4612-a92f-9e93cb8ea93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:36.414251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e68b-6d7b-4612-a92f-9e93cb8ea93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:36.414998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e68b-6d7b-4612-a92f-9e93cb8ea93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:36.417859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e68b-6d7b-4612-a92f-9e93cb8ea93f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:36.447552 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1046/2118] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:36.449334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e68b-6d7b-4612-a92f-9e93cb8ea93f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:36.460778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1073/2119] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:36.467834 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e68b-6d7b-4612-a92f-9e93cb8ea93f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:36.472915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e7ee2-2bc2-41dd-8201-574fbd7e78db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:36.473747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e7ee2-2bc2-41dd-8201-574fbd7e78db admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:36.474098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e7ee2-2bc2-41dd-8201-574fbd7e78db admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:36.474442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e7ee2-2bc2-41dd-8201-574fbd7e78db admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:36.474857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fb251-36ae-40f7-ab05-c66378dc0b2e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:36.475548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e7ee2-2bc2-41dd-8201-574fbd7e78db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:36.476791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0a8fb251-36ae-40f7-ab05-c66378dc0b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:36.494345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e7ee2-2bc2-41dd-8201-574fbd7e78db admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:36.520812 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1047/2120] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:36.526658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e7ee2-2bc2-41dd-8201-574fbd7e78db admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:36.539254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e7ee2-2bc2-41dd-8201-574fbd7e78db admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:36.546378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f573d91-e4c0-41e3-8cc8-e6676982037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:36.547133 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f573d91-e4c0-41e3-8cc8-e6676982037a admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:36.547424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f573d91-e4c0-41e3-8cc8-e6676982037a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:36.547699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f573d91-e4c0-41e3-8cc8-e6676982037a admin admin] PATH_INFO: `/v3/projects/1025e209cf644a4ab6afee3785f6568c/users/8575981034704de584e8a20d3d5f39af/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:36.579119 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fb251-36ae-40f7-ab05-c66378dc0b2e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:36.583708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be706c-672b-46f5-8918-dcb1ff4e8549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:36.586063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be706c-672b-46f5-8918-dcb1ff4e8549 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:36.586063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be706c-672b-46f5-8918-dcb1ff4e8549 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:36.586063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be706c-672b-46f5-8918-dcb1ff4e8549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:36.588214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-06be706c-672b-46f5-8918-dcb1ff4e8549 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:36.590979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f573d91-e4c0-41e3-8cc8-e6676982037a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1025e209cf644a4ab6afee3785f6568c, user_id=8575981034704de584e8a20d3d5f39af, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:36.598839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f573d91-e4c0-41e3-8cc8-e6676982037a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:36.609507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:36.675977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be706c-672b-46f5-8918-dcb1ff4e8549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:36.677528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be706c-672b-46f5-8918-dcb1ff4e8549 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:36.688550 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1074/2121] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:36.717518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1048/2122] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:36 2022] PUT /identity/v3/projects/1025e209cf644a4ab6afee3785f6568c/users/8575981034704de584e8a20d3d5f39af/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:36.718855 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81741eaa-a408-424d-9204-9474af9b8450 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:36.719174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81741eaa-a408-424d-9204-9474af9b8450 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:36.719525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81741eaa-a408-424d-9204-9474af9b8450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:36.792850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-81741eaa-a408-424d-9204-9474af9b8450 None None] MFA Rules not processed for user `8575981034704de584e8a20d3d5f39af`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:36.794152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-81741eaa-a408-424d-9204-9474af9b8450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:36.924068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1075/2123] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:36.928299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f573d91-e4c0-41e3-8cc8-e6676982037a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:37.008502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:37.013011 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f573d91-e4c0-41e3-8cc8-e6676982037a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:37.017749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9a365-c678-452f-b62e-53ceb27c776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:37.018490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a365-c678-452f-b62e-53ceb27c776c admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:37.024453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a365-c678-452f-b62e-53ceb27c776c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:37.024453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a365-c678-452f-b62e-53ceb27c776c admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:37.024453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9a365-c678-452f-b62e-53ceb27c776c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:37.025921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9a365-c678-452f-b62e-53ceb27c776c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:37.152774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1049/2124] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:36 2022] POST /identity/v3/projects => generated 389 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:37.154710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81741eaa-a408-424d-9204-9474af9b8450 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:37.171396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81741eaa-a408-424d-9204-9474af9b8450 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:37.252576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295e5d8-3235-451d-9e04-371b7e485744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:37.253157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e5d8-3235-451d-9e04-371b7e485744 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:37.253442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e5d8-3235-451d-9e04-371b7e485744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:37.254040 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e5d8-3235-451d-9e04-371b7e485744 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:37.254716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295e5d8-3235-451d-9e04-371b7e485744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:37.257682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295e5d8-3235-451d-9e04-371b7e485744 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:37.432967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1076/2125] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:37 2022] POST /identity/v3/users => generated 301 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:05:37.438922 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9a365-c678-452f-b62e-53ceb27c776c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:37.452862 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9a365-c678-452f-b62e-53ceb27c776c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:37.459447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830506f-f016-4eb6-8e88-68ed7882ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:37.460193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830506f-f016-4eb6-8e88-68ed7882ce0b admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:37.460542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830506f-f016-4eb6-8e88-68ed7882ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:37.460903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830506f-f016-4eb6-8e88-68ed7882ce0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:37.461703 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830506f-f016-4eb6-8e88-68ed7882ce0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:37.464262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830506f-f016-4eb6-8e88-68ed7882ce0b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:37.475792 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1050/2126] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:37.480548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295e5d8-3235-451d-9e04-371b7e485744 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:37.492832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295e5d8-3235-451d-9e04-371b7e485744 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:37.508325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fc64-6616-4983-a2d8-2bd9df909e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:37.509324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fc64-6616-4983-a2d8-2bd9df909e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:37.510059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fc64-6616-4983-a2d8-2bd9df909e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:37.510644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fc64-6616-4983-a2d8-2bd9df909e1a admin admin] PATH_INFO: `/v3/projects/abb644d937be4966912bc531cef3eb6a/users/abd4d51962ab4c23b1b37f8486d0ca74/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:37.530961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652fc64-6616-4983-a2d8-2bd9df909e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb644d937be4966912bc531cef3eb6a, user_id=abd4d51962ab4c23b1b37f8486d0ca74, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:37.541634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652fc64-6616-4983-a2d8-2bd9df909e1a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:38.067134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1077/2127] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:37 2022] PUT /identity/v3/projects/abb644d937be4966912bc531cef3eb6a/users/abd4d51962ab4c23b1b37f8486d0ca74/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:38.078473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830506f-f016-4eb6-8e88-68ed7882ce0b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:38.089198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830506f-f016-4eb6-8e88-68ed7882ce0b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:38.145835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbb14a-e6a3-4e93-8c2a-e1c60bb32658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:38.146474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbb14a-e6a3-4e93-8c2a-e1c60bb32658 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:38.146757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbb14a-e6a3-4e93-8c2a-e1c60bb32658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:38.147036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbb14a-e6a3-4e93-8c2a-e1c60bb32658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:38.147735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbb14a-e6a3-4e93-8c2a-e1c60bb32658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:38.149851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbb14a-e6a3-4e93-8c2a-e1c60bb32658 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:38.159511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1051/2128] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:38.163842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fc64-6616-4983-a2d8-2bd9df909e1a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:38.197672 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fc64-6616-4983-a2d8-2bd9df909e1a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:38.202289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a11dd-aa27-460f-b82f-cc6572fc9310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:38.202956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a11dd-aa27-460f-b82f-cc6572fc9310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:38.203235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a11dd-aa27-460f-b82f-cc6572fc9310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:38.203503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a11dd-aa27-460f-b82f-cc6572fc9310 admin admin] PATH_INFO: `/v3/projects/abb644d937be4966912bc531cef3eb6a/users/abd4d51962ab4c23b1b37f8486d0ca74/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:38.207144 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a11dd-aa27-460f-b82f-cc6572fc9310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb644d937be4966912bc531cef3eb6a, user_id=abd4d51962ab4c23b1b37f8486d0ca74, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:38.209810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a11dd-aa27-460f-b82f-cc6572fc9310 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:38.215436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:38.220864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1078/2129] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:38 2022] PUT /identity/v3/projects/abb644d937be4966912bc531cef3eb6a/users/abd4d51962ab4c23b1b37f8486d0ca74/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:38.232515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db919-e329-46b2-9938-d2cfc68db120 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:38.232829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db919-e329-46b2-9938-d2cfc68db120 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:38.233106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db919-e329-46b2-9938-d2cfc68db120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:38.263569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3e6db919-e329-46b2-9938-d2cfc68db120 None None] MFA Rules not processed for user `abd4d51962ab4c23b1b37f8486d0ca74`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:38.266940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3e6db919-e329-46b2-9938-d2cfc68db120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:38.350458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1052/2130] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:38.374687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a11dd-aa27-460f-b82f-cc6572fc9310 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:38.380166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b05a11dd-aa27-460f-b82f-cc6572fc9310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:38.480963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a11dd-aa27-460f-b82f-cc6572fc9310 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:38.488337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2380b-7ca3-434a-aaa8-c0ceab695f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:38.489282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2380b-7ca3-434a-aaa8-c0ceab695f9b service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:38.489572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2380b-7ca3-434a-aaa8-c0ceab695f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:38.489849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2380b-7ca3-434a-aaa8-c0ceab695f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:38.500915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2380b-7ca3-434a-aaa8-c0ceab695f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:38.502495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2380b-7ca3-434a-aaa8-c0ceab695f9b service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:38.512863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1079/2131] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:38.679128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6db919-e329-46b2-9938-d2cfc68db120 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:38.765081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:38.772953 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6db919-e329-46b2-9938-d2cfc68db120 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:38.779464 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:38.780114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:38.780387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:38.780664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] PATH_INFO: `/v3/users/8575981034704de584e8a20d3d5f39af` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:38.781882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8575981034704de584e8a20d3d5f39af)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:38.783832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:38.969562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8575981034704de584e8a20d3d5f39af'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:38.970257 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8575981034704de584e8a20d3d5f39af'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:39.031650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8575981034704de584e8a20d3d5f39af'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:39.066710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8575981034704de584e8a20d3d5f39af'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:39.075729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8575981034704de584e8a20d3d5f39af'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:39.085105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1053/2132] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:38 2022] DELETE /identity/v3/users/8575981034704de584e8a20d3d5f39af => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:39.090410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a325-1bea-4694-a9fc-4165a690bc1c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:39.090891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a325-1bea-4694-a9fc-4165a690bc1c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:39.095490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a325-1bea-4694-a9fc-4165a690bc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:39.113869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9dd2a325-1bea-4694-a9fc-4165a690bc1c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:39.115237 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9dd2a325-1bea-4694-a9fc-4165a690bc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:39.210544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1080/2133] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:39.218199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:39.219776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:39.298208 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee8a99-4ca5-4769-a5ed-5c3aba3333b4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:39.302904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8dcbf-cf4a-413d-9c07-c53c3f9348a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:39.304126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8dcbf-cf4a-413d-9c07-c53c3f9348a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:39.304126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8dcbf-cf4a-413d-9c07-c53c3f9348a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:39.304357 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8dcbf-cf4a-413d-9c07-c53c3f9348a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:39.319755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8dcbf-cf4a-413d-9c07-c53c3f9348a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:39.322106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8dcbf-cf4a-413d-9c07-c53c3f9348a8 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:39.334672 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1054/2134] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:39.925493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2a325-1bea-4694-a9fc-4165a690bc1c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:39.932231 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9dd2a325-1bea-4694-a9fc-4165a690bc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:39.963974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2a325-1bea-4694-a9fc-4165a690bc1c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:39.981172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:39.981935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:39.982131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:39.982402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] PATH_INFO: `/v3/projects/1025e209cf644a4ab6afee3785f6568c` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:39.992023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1025e209cf644a4ab6afee3785f6568c)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:39.995038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:40.203394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1025e209cf644a4ab6afee3785f6568c', 'request_id': 'req-9323905d-1ba9-4448-8e32-a8e81445bf98'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.209089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1025e209cf644a4ab6afee3785f6568c', 'request_id': 'req-9323905d-1ba9-4448-8e32-a8e81445bf98'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.218076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1025e209cf644a4ab6afee3785f6568c', 'request_id': 'req-9323905d-1ba9-4448-8e32-a8e81445bf98'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.314517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] The token cache is being invalidate because project 1025e209cf644a4ab6afee3785f6568c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:40.315113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.318297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.320402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1081/2135] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:39 2022] DELETE /identity/v3/projects/1025e209cf644a4ab6afee3785f6568c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:40.324911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8dcbf-cf4a-413d-9c07-c53c3f9348a8 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:40.334944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8dcbf-cf4a-413d-9c07-c53c3f9348a8 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:40.355818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:40.357328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:40.412558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:40.413439 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:40.413895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:40.414328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] PATH_INFO: `/v3/users/abd4d51962ab4c23b1b37f8486d0ca74` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:40.416680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd4d51962ab4c23b1b37f8486d0ca74)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:40.418905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:40.447812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:40.469594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:40.611885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323905d-1ba9-4448-8e32-a8e81445bf98 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:40.627978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:40.628660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:40.628945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:40.629352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] PATH_INFO: `/v3/users/456bce61404d4b9f9af5eb8328973a58` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:40.631445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456bce61404d4b9f9af5eb8328973a58)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:40.633709 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:40.702515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd4d51962ab4c23b1b37f8486d0ca74'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.704301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd4d51962ab4c23b1b37f8486d0ca74'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.799252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd4d51962ab4c23b1b37f8486d0ca74'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.816969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd4d51962ab4c23b1b37f8486d0ca74'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.824975 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-fca7eda7-ef4a-4774-af66-4fb29301f161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd4d51962ab4c23b1b37f8486d0ca74'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.834235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1055/2136] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:40 2022] DELETE /identity/v3/users/abd4d51962ab4c23b1b37f8486d0ca74 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:40.891632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456bce61404d4b9f9af5eb8328973a58'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:40.925648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456bce61404d4b9f9af5eb8328973a58'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:41.000623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456bce61404d4b9f9af5eb8328973a58'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:41.000623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456bce61404d4b9f9af5eb8328973a58'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:41.000623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456bce61404d4b9f9af5eb8328973a58'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:41.023380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1082/2137] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:40 2022] DELETE /identity/v3/users/456bce61404d4b9f9af5eb8328973a58 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:41.028973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6bb25-09ca-4575-a8ab-a45e14fb47f3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:41.029330 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6bb25-09ca-4575-a8ab-a45e14fb47f3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:41.029629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6bb25-09ca-4575-a8ab-a45e14fb47f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:41.056245 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8fd6bb25-09ca-4575-a8ab-a45e14fb47f3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:41.057829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8fd6bb25-09ca-4575-a8ab-a45e14fb47f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:41.179366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1056/2138] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:41.191355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:41.192944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:41.277204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7b01c-c047-43f4-bb17-69123c379e85 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:41.282448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ad3e-7729-4106-a915-ccfce6c90c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:41.283312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ad3e-7729-4106-a915-ccfce6c90c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:41.286584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ad3e-7729-4106-a915-ccfce6c90c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:41.286916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ad3e-7729-4106-a915-ccfce6c90c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:41.307279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ad3e-7729-4106-a915-ccfce6c90c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:41.309243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ad3e-7729-4106-a915-ccfce6c90c84 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:41.323968 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1083/2139] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:41.398264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6bb25-09ca-4575-a8ab-a45e14fb47f3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:41.404893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8fd6bb25-09ca-4575-a8ab-a45e14fb47f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:41.429346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6bb25-09ca-4575-a8ab-a45e14fb47f3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:41.447394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:41.448553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:41.448829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:41.449885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] PATH_INFO: `/v3/projects/abb644d937be4966912bc531cef3eb6a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:41.451748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb644d937be4966912bc531cef3eb6a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:41.453923 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:41.682702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb644d937be4966912bc531cef3eb6a', 'request_id': 'req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:41.690847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb644d937be4966912bc531cef3eb6a', 'request_id': 'req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:42.231419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb644d937be4966912bc531cef3eb6a', 'request_id': 'req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:42.242843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] The token cache is being invalidate because project abb644d937be4966912bc531cef3eb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:42.243873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:42.244531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:42.246107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1057/2140] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:41 2022] DELETE /identity/v3/projects/abb644d937be4966912bc531cef3eb6a => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:42.250914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bf302-98cb-48ca-873d-ccbc478768e0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:42.251203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bf302-98cb-48ca-873d-ccbc478768e0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:42.251478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bf302-98cb-48ca-873d-ccbc478768e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:42.272263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a68bf302-98cb-48ca-873d-ccbc478768e0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:42.273468 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a68bf302-98cb-48ca-873d-ccbc478768e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:42.308604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:42.314136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:42.328997 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:42.357629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1084/2141] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:42.360195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bf302-98cb-48ca-873d-ccbc478768e0 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:42.361039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:42.365081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a68bf302-98cb-48ca-873d-ccbc478768e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:42.427439 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7581e5a-8c3c-43c8-97c1-5bf9c77a3cf0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:42.434042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:42.435037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:42.435514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:42.436088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] PATH_INFO: `/v3/projects/a8d5185464a44efd9ce96a4a2e5e1ebd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:42.436661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bf302-98cb-48ca-873d-ccbc478768e0 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:42.437829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d5185464a44efd9ce96a4a2e5e1ebd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:42.440267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:42.440875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1cc86-3078-49be-98fe-14db1824e9d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:42.441567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1cc86-3078-49be-98fe-14db1824e9d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:42.441846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1cc86-3078-49be-98fe-14db1824e9d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:42.442304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1cc86-3078-49be-98fe-14db1824e9d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:42.444109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1ad1cc86-3078-49be-98fe-14db1824e9d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:42.519170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1cc86-3078-49be-98fe-14db1824e9d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:42.520739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1cc86-3078-49be-98fe-14db1824e9d9 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:42.531340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1085/2142] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:42.532608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20048ec-a203-4060-94a4-02741a9878c4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:42.532956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20048ec-a203-4060-94a4-02741a9878c4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:42.533299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20048ec-a203-4060-94a4-02741a9878c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:42.563633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b20048ec-a203-4060-94a4-02741a9878c4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:42.565648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b20048ec-a203-4060-94a4-02741a9878c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:42.571893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d5185464a44efd9ce96a4a2e5e1ebd', 'request_id': 'req-3f2875e0-c12d-41d2-808e-aa0d65d9156d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:42.583120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d5185464a44efd9ce96a4a2e5e1ebd', 'request_id': 'req-3f2875e0-c12d-41d2-808e-aa0d65d9156d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:42.642573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1086/2143] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:42.648614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d5185464a44efd9ce96a4a2e5e1ebd', 'request_id': 'req-3f2875e0-c12d-41d2-808e-aa0d65d9156d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:42.648785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20048ec-a203-4060-94a4-02741a9878c4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:42.660600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20048ec-a203-4060-94a4-02741a9878c4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:42.663333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] The token cache is being invalidate because project a8d5185464a44efd9ce96a4a2e5e1ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:42.664094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:42.665779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:42.666379 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817f16c-7330-4f67-aafe-516b0390c5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:42.667025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817f16c-7330-4f67-aafe-516b0390c5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:42.667307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817f16c-7330-4f67-aafe-516b0390c5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:42.667580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817f16c-7330-4f67-aafe-516b0390c5b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:42.668319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817f16c-7330-4f67-aafe-516b0390c5b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:42.668771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817f16c-7330-4f67-aafe-516b0390c5b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:42.668969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1058/2144] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:42 2022] DELETE /identity/v3/projects/a8d5185464a44efd9ce96a4a2e5e1ebd => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:42.670265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817f16c-7330-4f67-aafe-516b0390c5b1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:42.673426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:42.675009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:42.685315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1087/2145] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:42.689562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817f16c-7330-4f67-aafe-516b0390c5b1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:42.690576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2875e0-c12d-41d2-808e-aa0d65d9156d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:42.691442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1817f16c-7330-4f67-aafe-516b0390c5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:42.696325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:42.697396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:42.697845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:42.698293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] PATH_INFO: `/v3/users/3ce5500d0e544e819dc6e8379f33af44` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:42.699626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce5500d0e544e819dc6e8379f33af44)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:42.701963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:42.707641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817f16c-7330-4f67-aafe-516b0390c5b1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:42.715802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ecfb-b49c-4757-b843-0b50039afec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:42.717047 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ecfb-b49c-4757-b843-0b50039afec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:42.717697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ecfb-b49c-4757-b843-0b50039afec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:42.718501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ecfb-b49c-4757-b843-0b50039afec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:42.719378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8ecfb-b49c-4757-b843-0b50039afec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:42.730608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8ecfb-b49c-4757-b843-0b50039afec5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:42.853911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1088/2146] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:42 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:42.854953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ecfb-b49c-4757-b843-0b50039afec5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:42.927572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ecfb-b49c-4757-b843-0b50039afec5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:42.933219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa48d5-a09d-488f-ab02-88cc19e0aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:42.933859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa48d5-a09d-488f-ab02-88cc19e0aaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:42.934142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa48d5-a09d-488f-ab02-88cc19e0aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:42.934421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa48d5-a09d-488f-ab02-88cc19e0aaa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:42.935096 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa48d5-a09d-488f-ab02-88cc19e0aaa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:42.937266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa48d5-a09d-488f-ab02-88cc19e0aaa8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:43.063393 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce5500d0e544e819dc6e8379f33af44'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:43.064094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce5500d0e544e819dc6e8379f33af44'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:43.123519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1089/2147] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:42 2022] POST /identity/v3/users => generated 284 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:43.124355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa48d5-a09d-488f-ab02-88cc19e0aaa8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:43.126023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d0aa48d5-a09d-488f-ab02-88cc19e0aaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:43.138587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa48d5-a09d-488f-ab02-88cc19e0aaa8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:43.144449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:43.144449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.145378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.145378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] PATH_INFO: `/v3/users/7439b689bf91437988a785f79a924720` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.146374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7439b689bf91437988a785f79a924720)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:43.148316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:43.164508 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce5500d0e544e819dc6e8379f33af44'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:43.179269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce5500d0e544e819dc6e8379f33af44'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:43.187604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce5500d0e544e819dc6e8379f33af44'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:43.193848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1059/2148] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:42 2022] DELETE /identity/v3/users/3ce5500d0e544e819dc6e8379f33af44 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:43.194628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:43.196538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:43.215563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:43.272098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807caae6-e147-404f-a92f-a3f31f06c579 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:43.278976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd13504-c4f3-40f6-bf8a-f2c4e56451de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:43.281460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd13504-c4f3-40f6-bf8a-f2c4e56451de admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.281460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd13504-c4f3-40f6-bf8a-f2c4e56451de admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.281460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd13504-c4f3-40f6-bf8a-f2c4e56451de admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.281460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd13504-c4f3-40f6-bf8a-f2c4e56451de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:43.282579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd13504-c4f3-40f6-bf8a-f2c4e56451de admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:43.293851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1060/2149] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:43.297961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd13504-c4f3-40f6-bf8a-f2c4e56451de admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:43.308822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd13504-c4f3-40f6-bf8a-f2c4e56451de admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:43.313810 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125a784-9ba7-4e4e-9fbe-5b701ec3d9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:43.314431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125a784-9ba7-4e4e-9fbe-5b701ec3d9ce admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.314714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125a784-9ba7-4e4e-9fbe-5b701ec3d9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.315017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125a784-9ba7-4e4e-9fbe-5b701ec3d9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.315774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125a784-9ba7-4e4e-9fbe-5b701ec3d9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:43.317503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125a784-9ba7-4e4e-9fbe-5b701ec3d9ce admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:43.331206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1061/2150] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:43.332806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125a784-9ba7-4e4e-9fbe-5b701ec3d9ce admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:43.343161 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125a784-9ba7-4e4e-9fbe-5b701ec3d9ce admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:43.347910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295071c8-de91-45c1-89c2-3f3b5d3df6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:43.348585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295071c8-de91-45c1-89c2-3f3b5d3df6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.348873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295071c8-de91-45c1-89c2-3f3b5d3df6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.349216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295071c8-de91-45c1-89c2-3f3b5d3df6ad admin admin] PATH_INFO: `/v3/projects/8959dcc710404fdba213a83e399db97e/users/78aeeaa628d24effb7cc63ee5faecc1f/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.364507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295071c8-de91-45c1-89c2-3f3b5d3df6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8959dcc710404fdba213a83e399db97e, user_id=78aeeaa628d24effb7cc63ee5faecc1f, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:43.367303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295071c8-de91-45c1-89c2-3f3b5d3df6ad admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:43.405000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7439b689bf91437988a785f79a924720'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:43.413547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7439b689bf91437988a785f79a924720'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:43.422275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:43.467888 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1062/2151] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:43 2022] PUT /identity/v3/projects/8959dcc710404fdba213a83e399db97e/users/78aeeaa628d24effb7cc63ee5faecc1f/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:43.478380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44278e4d-8bd3-4643-ac4c-7a9e4c217baf None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.478683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44278e4d-8bd3-4643-ac4c-7a9e4c217baf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.478976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44278e4d-8bd3-4643-ac4c-7a9e4c217baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.489392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7439b689bf91437988a785f79a924720'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:43.493518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7439b689bf91437988a785f79a924720'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:43.493518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a5b541f7-a2a3-45fc-960a-31f46528ff6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7439b689bf91437988a785f79a924720'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:43.511577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-44278e4d-8bd3-4643-ac4c-7a9e4c217baf None None] MFA Rules not processed for user `78aeeaa628d24effb7cc63ee5faecc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:43.512221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1090/2152] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:43 2022] DELETE /identity/v3/users/7439b689bf91437988a785f79a924720 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:43.513222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-44278e4d-8bd3-4643-ac4c-7a9e4c217baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:43.516824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406d69-7475-4b1b-8c80-a34756e89a31 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.517140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406d69-7475-4b1b-8c80-a34756e89a31 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.517430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406d69-7475-4b1b-8c80-a34756e89a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.537495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-bc406d69-7475-4b1b-8c80-a34756e89a31 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:43.538762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bc406d69-7475-4b1b-8c80-a34756e89a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:43.594118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1063/2153] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:43.595300 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44278e4d-8bd3-4643-ac4c-7a9e4c217baf None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:43.596673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-44278e4d-8bd3-4643-ac4c-7a9e4c217baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:43.621154 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1091/2154] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:43.624403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b441af3-6c31-4081-9558-44c23339ceaa None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.624930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b441af3-6c31-4081-9558-44c23339ceaa None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.625528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b441af3-6c31-4081-9558-44c23339ceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.645498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6b441af3-6c31-4081-9558-44c23339ceaa None None] MFA Rules not processed for user `2c4c72b9c83a4967b57b6633f9934dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:43.646750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6b441af3-6c31-4081-9558-44c23339ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:43.669554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44278e4d-8bd3-4643-ac4c-7a9e4c217baf None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:43.673476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9222ccb-1f00-4aae-9315-06736c02988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:43.674127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222ccb-1f00-4aae-9315-06736c02988b admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.675026 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222ccb-1f00-4aae-9315-06736c02988b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.675424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222ccb-1f00-4aae-9315-06736c02988b admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.676255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9222ccb-1f00-4aae-9315-06736c02988b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:43.678332 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9222ccb-1f00-4aae-9315-06736c02988b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:43.713565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1092/2155] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:43.714608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b441af3-6c31-4081-9558-44c23339ceaa None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:43.716243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6b441af3-6c31-4081-9558-44c23339ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:43.778414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1064/2156] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:43 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:43.779880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9222ccb-1f00-4aae-9315-06736c02988b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:43.783959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b441af3-6c31-4081-9558-44c23339ceaa None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:43.789150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a9222ccb-1f00-4aae-9315-06736c02988b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:43.837529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48747a33-d47e-4593-a1a5-1bcd638e1d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:43.838567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48747a33-d47e-4593-a1a5-1bcd638e1d31 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.839016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48747a33-d47e-4593-a1a5-1bcd638e1d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.839480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48747a33-d47e-4593-a1a5-1bcd638e1d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.876144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9222ccb-1f00-4aae-9315-06736c02988b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:43.886489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:43.887254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.887600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.888801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] PATH_INFO: `/v3/projects/ebc28ffad755490290ec1bce6d77918e` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.890419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc28ffad755490290ec1bce6d77918e)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:43.892683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:43.901919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:43.922716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48747a33-d47e-4593-a1a5-1bcd638e1d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:43.924266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48747a33-d47e-4593-a1a5-1bcd638e1d31 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:43.937597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1093/2157] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:43.938647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48747a33-d47e-4593-a1a5-1bcd638e1d31 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:43.949206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48747a33-d47e-4593-a1a5-1bcd638e1d31 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:43.955145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98eed7-6ee2-4604-b160-63a6585e595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:43.955850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98eed7-6ee2-4604-b160-63a6585e595d admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:43.956139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98eed7-6ee2-4604-b160-63a6585e595d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:43.956489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98eed7-6ee2-4604-b160-63a6585e595d admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:43.959138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98eed7-6ee2-4604-b160-63a6585e595d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:43.959744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98eed7-6ee2-4604-b160-63a6585e595d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:44.027156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc28ffad755490290ec1bce6d77918e', 'request_id': 'req-f90be105-0778-4870-ac60-772bedc02a5a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:44.034514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc28ffad755490290ec1bce6d77918e', 'request_id': 'req-f90be105-0778-4870-ac60-772bedc02a5a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:44.053383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1094/2158] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:43 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:44.057104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98eed7-6ee2-4604-b160-63a6585e595d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:44.071818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98eed7-6ee2-4604-b160-63a6585e595d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:44.136139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d4d0f-affd-4d23-a466-6bba66eb5b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:44.136878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4d0f-affd-4d23-a466-6bba66eb5b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.137112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc28ffad755490290ec1bce6d77918e', 'request_id': 'req-f90be105-0778-4870-ac60-772bedc02a5a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:44.137370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4d0f-affd-4d23-a466-6bba66eb5b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.137657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4d0f-affd-4d23-a466-6bba66eb5b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.138974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d4d0f-affd-4d23-a466-6bba66eb5b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:44.140394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d4d0f-affd-4d23-a466-6bba66eb5b4e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:44.151973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] The token cache is being invalidate because project ebc28ffad755490290ec1bce6d77918e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:44.152181 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:44.153158 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:44.156407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1065/2160] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:43 2022] DELETE /identity/v3/projects/ebc28ffad755490290ec1bce6d77918e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:44.156556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1095/2160] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:44.157146 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:44.159018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:44.161535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cab597-2dfc-4eac-bfa5-da804a0e0201 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.161535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cab597-2dfc-4eac-bfa5-da804a0e0201 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.161883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cab597-2dfc-4eac-bfa5-da804a0e0201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.178997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90be105-0778-4870-ac60-772bedc02a5a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:44.183878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-52cab597-2dfc-4eac-bfa5-da804a0e0201 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:44.185176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-52cab597-2dfc-4eac-bfa5-da804a0e0201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:44.186439 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf512cf-5d84-4e12-83ba-50c255b9cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:44.187198 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf512cf-5d84-4e12-83ba-50c255b9cf83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.187700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf512cf-5d84-4e12-83ba-50c255b9cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.188154 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf512cf-5d84-4e12-83ba-50c255b9cf83 admin admin] PATH_INFO: `/v3/projects/b9464ef64de249a6b1ce01865c5d7bb8/users/a2613fb3f12a47e3ab9f0232db9f0d38/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.195452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1096/2161] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:44.203682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8140-3978-4158-82bc-d6ad77d58c9d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.203971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8140-3978-4158-82bc-d6ad77d58c9d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.204251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8140-3978-4158-82bc-d6ad77d58c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.209446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf512cf-5d84-4e12-83ba-50c255b9cf83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9464ef64de249a6b1ce01865c5d7bb8, user_id=a2613fb3f12a47e3ab9f0232db9f0d38, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:44.214444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf512cf-5d84-4e12-83ba-50c255b9cf83 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:44.226418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a5fb8140-3978-4158-82bc-d6ad77d58c9d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:44.227806 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a5fb8140-3978-4158-82bc-d6ad77d58c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:44.237199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1097/2162] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:44.245161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb8140-3978-4158-82bc-d6ad77d58c9d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:44.254975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb8140-3978-4158-82bc-d6ad77d58c9d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:44.262663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205913eb-13eb-4344-8978-76be06124753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:44.262663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205913eb-13eb-4344-8978-76be06124753 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.262663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205913eb-13eb-4344-8978-76be06124753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.263034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205913eb-13eb-4344-8978-76be06124753 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.263481 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205913eb-13eb-4344-8978-76be06124753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:44.263784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205913eb-13eb-4344-8978-76be06124753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:44.265423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205913eb-13eb-4344-8978-76be06124753 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:44.286536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1098/2163] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:05:44.290945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205913eb-13eb-4344-8978-76be06124753 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:44.305224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205913eb-13eb-4344-8978-76be06124753 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:44.311010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1066/2164] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:44 2022] PUT /identity/v3/projects/b9464ef64de249a6b1ce01865c5d7bb8/users/a2613fb3f12a47e3ab9f0232db9f0d38/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:44.312259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf512cf-5d84-4e12-83ba-50c255b9cf83 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:44.425511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf512cf-5d84-4e12-83ba-50c255b9cf83 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:44.433707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875bbe8-e479-4c26-aa33-e8fd7cb12e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:44.434436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875bbe8-e479-4c26-aa33-e8fd7cb12e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.434794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875bbe8-e479-4c26-aa33-e8fd7cb12e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.435143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875bbe8-e479-4c26-aa33-e8fd7cb12e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.436088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875bbe8-e479-4c26-aa33-e8fd7cb12e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:44.438127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875bbe8-e479-4c26-aa33-e8fd7cb12e12 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:44.457161 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1067/2165] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:44.459637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875bbe8-e479-4c26-aa33-e8fd7cb12e12 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:44.469526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbece8-6f09-4672-8bdd-d863c04a11d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:44.469526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbece8-6f09-4672-8bdd-d863c04a11d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.469526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbece8-6f09-4672-8bdd-d863c04a11d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.469526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbece8-6f09-4672-8bdd-d863c04a11d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.470543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbece8-6f09-4672-8bdd-d863c04a11d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:44.472670 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875bbe8-e479-4c26-aa33-e8fd7cb12e12 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:44.473147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbece8-6f09-4672-8bdd-d863c04a11d7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:44.497153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa92059-dc39-4f9a-b9b3-dfba276995ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:44.503621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa92059-dc39-4f9a-b9b3-dfba276995ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.503621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa92059-dc39-4f9a-b9b3-dfba276995ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.503621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa92059-dc39-4f9a-b9b3-dfba276995ff admin admin] PATH_INFO: `/v3/projects/b9464ef64de249a6b1ce01865c5d7bb8/users/a2613fb3f12a47e3ab9f0232db9f0d38/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.506962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa92059-dc39-4f9a-b9b3-dfba276995ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9464ef64de249a6b1ce01865c5d7bb8, user_id=a2613fb3f12a47e3ab9f0232db9f0d38, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:44.512737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa92059-dc39-4f9a-b9b3-dfba276995ff admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:44.538090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1068/2166] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:44 2022] PUT /identity/v3/projects/b9464ef64de249a6b1ce01865c5d7bb8/users/a2613fb3f12a47e3ab9f0232db9f0d38/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:44.538090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:44.547145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef29eef-347d-4e05-a222-58de9c2bbe03 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.547989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef29eef-347d-4e05-a222-58de9c2bbe03 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.547989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef29eef-347d-4e05-a222-58de9c2bbe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.605822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4ef29eef-347d-4e05-a222-58de9c2bbe03 None None] MFA Rules not processed for user `a2613fb3f12a47e3ab9f0232db9f0d38`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:44.607728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4ef29eef-347d-4e05-a222-58de9c2bbe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:44.621263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1099/2167] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:44 2022] POST /identity/v3/projects => generated 379 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:44.623703 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbece8-6f09-4672-8bdd-d863c04a11d7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:44.707957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1069/2168] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:44 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:44.712946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbece8-6f09-4672-8bdd-d863c04a11d7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:44.716839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef29eef-347d-4e05-a222-58de9c2bbe03 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:44.718562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efcdb6-f990-4136-aebb-4287aca403d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:44.718707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4ef29eef-347d-4e05-a222-58de9c2bbe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:44.719389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efcdb6-f990-4136-aebb-4287aca403d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.719645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efcdb6-f990-4136-aebb-4287aca403d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.719936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efcdb6-f990-4136-aebb-4287aca403d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.720611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efcdb6-f990-4136-aebb-4287aca403d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:44.722752 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efcdb6-f990-4136-aebb-4287aca403d6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:44.808683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1100/2169] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:44 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:44.809598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efcdb6-f990-4136-aebb-4287aca403d6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:44.812904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f5efcdb6-f990-4136-aebb-4287aca403d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:44.829697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efcdb6-f990-4136-aebb-4287aca403d6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:44.833463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef29eef-347d-4e05-a222-58de9c2bbe03 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:44.837461 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:44.838226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.838579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.838930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] PATH_INFO: `/v3/projects/4ccf6fa240434e8bb4957bc879a7127e` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.841304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ccf6fa240434e8bb4957bc879a7127e)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:44.843154 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:44.911535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e50c-6bf1-41ef-a27a-39ba5f1d7190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:44.912170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e50c-6bf1-41ef-a27a-39ba5f1d7190 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:44.912497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e50c-6bf1-41ef-a27a-39ba5f1d7190 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:44.912721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e50c-6bf1-41ef-a27a-39ba5f1d7190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:44.963746 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ccf6fa240434e8bb4957bc879a7127e', 'request_id': 'req-183db146-d96f-4237-8473-bbb24688bf18'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:44.971067 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ccf6fa240434e8bb4957bc879a7127e', 'request_id': 'req-183db146-d96f-4237-8473-bbb24688bf18'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:44.976633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ccf6fa240434e8bb4957bc879a7127e', 'request_id': 'req-183db146-d96f-4237-8473-bbb24688bf18'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:44.981473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e50c-6bf1-41ef-a27a-39ba5f1d7190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:44.983042 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e50c-6bf1-41ef-a27a-39ba5f1d7190 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:44.994124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1070/2170] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:44 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:05:44.994946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e50c-6bf1-41ef-a27a-39ba5f1d7190 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:45.005025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e50c-6bf1-41ef-a27a-39ba5f1d7190 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:45.048145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] The token cache is being invalidate because project 4ccf6fa240434e8bb4957bc879a7127e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:45.048614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:45.049382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:45.051058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1101/2171] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:44 2022] DELETE /identity/v3/projects/4ccf6fa240434e8bb4957bc879a7127e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:45.054844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:45.057031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:45.063077 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73473e-0a83-46d1-86dc-47155487c7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:45.063699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73473e-0a83-46d1-86dc-47155487c7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:45.063978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73473e-0a83-46d1-86dc-47155487c7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:45.064245 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73473e-0a83-46d1-86dc-47155487c7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:45.064955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73473e-0a83-46d1-86dc-47155487c7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:45.067783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73473e-0a83-46d1-86dc-47155487c7c7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:45.075630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183db146-d96f-4237-8473-bbb24688bf18 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:45.081449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:45.082109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:45.082390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:45.082666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] PATH_INFO: `/v3/users/83e8768ce38f4ab2ab5a9c1c962ef392` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:45.083872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e8768ce38f4ab2ab5a9c1c962ef392)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:45.085903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:45.087920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1071/2172] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:45.091509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73473e-0a83-46d1-86dc-47155487c7c7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:45.093367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fa73473e-0a83-46d1-86dc-47155487c7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:45.108201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73473e-0a83-46d1-86dc-47155487c7c7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:45.113481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669debc-fe70-44d1-9eab-4bb4624ff237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:45.113687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669debc-fe70-44d1-9eab-4bb4624ff237 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:45.113969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669debc-fe70-44d1-9eab-4bb4624ff237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:45.114245 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669debc-fe70-44d1-9eab-4bb4624ff237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:45.114941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669debc-fe70-44d1-9eab-4bb4624ff237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:45.116795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669debc-fe70-44d1-9eab-4bb4624ff237 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:45.127883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1072/2173] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:45.132009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669debc-fe70-44d1-9eab-4bb4624ff237 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:45.141692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669debc-fe70-44d1-9eab-4bb4624ff237 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:45.146519 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf4409-ce08-4a6f-b16a-1741b64d68b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:45.147175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4409-ce08-4a6f-b16a-1741b64d68b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:45.147577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4409-ce08-4a6f-b16a-1741b64d68b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:45.147737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4409-ce08-4a6f-b16a-1741b64d68b4 admin admin] PATH_INFO: `/v3/projects/c3a0155ba92146ea81cf12a4e7d8df13/users/a4cde07799954fde908b515a0c154267/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:45.164140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf4409-ce08-4a6f-b16a-1741b64d68b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a0155ba92146ea81cf12a4e7d8df13, user_id=a4cde07799954fde908b515a0c154267, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:45.167490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf4409-ce08-4a6f-b16a-1741b64d68b4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:45.271889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1073/2174] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:45 2022] PUT /identity/v3/projects/c3a0155ba92146ea81cf12a4e7d8df13/users/a4cde07799954fde908b515a0c154267/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:45.273715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf4409-ce08-4a6f-b16a-1741b64d68b4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:45.274464 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-dbbf4409-ce08-4a6f-b16a-1741b64d68b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:45.316598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e8768ce38f4ab2ab5a9c1c962ef392'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:45.325039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e8768ce38f4ab2ab5a9c1c962ef392'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:45.336007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf4409-ce08-4a6f-b16a-1741b64d68b4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:45.340655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb70d84-ae9c-45b1-8062-daafa145b6b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:45.341328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb70d84-ae9c-45b1-8062-daafa145b6b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:45.341645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb70d84-ae9c-45b1-8062-daafa145b6b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:45.341879 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb70d84-ae9c-45b1-8062-daafa145b6b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:45.343652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bbb70d84-ae9c-45b1-8062-daafa145b6b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:45.413255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb70d84-ae9c-45b1-8062-daafa145b6b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:45.415199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb70d84-ae9c-45b1-8062-daafa145b6b4 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:45.424414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1074/2175] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:45.425738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381503-8cb1-4ea8-8e64-05304438c012 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:45.425990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381503-8cb1-4ea8-8e64-05304438c012 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:45.426262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381503-8cb1-4ea8-8e64-05304438c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:45.459472 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-32381503-8cb1-4ea8-8e64-05304438c012 None None] MFA Rules not processed for user `a4cde07799954fde908b515a0c154267`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:45.460864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-32381503-8cb1-4ea8-8e64-05304438c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:45.534658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e8768ce38f4ab2ab5a9c1c962ef392'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:45.535321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e8768ce38f4ab2ab5a9c1c962ef392'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:45.535982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e8768ce38f4ab2ab5a9c1c962ef392'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:45.556787 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1075/2176] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:45.560071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381503-8cb1-4ea8-8e64-05304438c012 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:45.563275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-32381503-8cb1-4ea8-8e64-05304438c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:45.564645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1102/2177] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:45 2022] DELETE /identity/v3/users/83e8768ce38f4ab2ab5a9c1c962ef392 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:45.662255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381503-8cb1-4ea8-8e64-05304438c012 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:45.720268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25178792-f557-4c5b-9544-cf18fc2e00e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:45.720890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25178792-f557-4c5b-9544-cf18fc2e00e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:45.721207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25178792-f557-4c5b-9544-cf18fc2e00e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:45.721523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25178792-f557-4c5b-9544-cf18fc2e00e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:45.722178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25178792-f557-4c5b-9544-cf18fc2e00e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:45.724087 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25178792-f557-4c5b-9544-cf18fc2e00e1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:45.803156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:45.911742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1076/2178] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:45 2022] POST /identity/v3/projects => generated 379 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:45.913365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:45.921017 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:45.929070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82e264-bc24-44fa-b55f-e468355c55b7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:46.020868 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212568a0-730d-4f1b-8863-597a686f9137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:46.021762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212568a0-730d-4f1b-8863-597a686f9137 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:46.022149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212568a0-730d-4f1b-8863-597a686f9137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:46.022526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212568a0-730d-4f1b-8863-597a686f9137 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:46.023316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212568a0-730d-4f1b-8863-597a686f9137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:46.025915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212568a0-730d-4f1b-8863-597a686f9137 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:46.163104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1103/2179] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:45 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:46.167770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25178792-f557-4c5b-9544-cf18fc2e00e1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:46.177880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25178792-f557-4c5b-9544-cf18fc2e00e1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:46.183072 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dc431-f185-4816-87ca-202b95134d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:46.183681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dc431-f185-4816-87ca-202b95134d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:46.184008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dc431-f185-4816-87ca-202b95134d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:46.184279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dc431-f185-4816-87ca-202b95134d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:46.185024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dc431-f185-4816-87ca-202b95134d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:46.186651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dc431-f185-4816-87ca-202b95134d1f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:46.197859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1077/2180] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:46.202169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212568a0-730d-4f1b-8863-597a686f9137 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:46.212563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212568a0-730d-4f1b-8863-597a686f9137 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:46.217374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04116e18-b46a-4c6c-ab85-e8174fcdd6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:46.218514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116e18-b46a-4c6c-ab85-e8174fcdd6db admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:46.218514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116e18-b46a-4c6c-ab85-e8174fcdd6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:46.218777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116e18-b46a-4c6c-ab85-e8174fcdd6db admin admin] PATH_INFO: `/v3/projects/bd8fd1b9147746bca9e63adaccffbb7f/users/9731bfcc82d246418965fc5774e3a24c/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:46.222319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dc431-f185-4816-87ca-202b95134d1f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:46.224495 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-192dc431-f185-4816-87ca-202b95134d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:46.237922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04116e18-b46a-4c6c-ab85-e8174fcdd6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8fd1b9147746bca9e63adaccffbb7f, user_id=9731bfcc82d246418965fc5774e3a24c, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:46.240166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dc431-f185-4816-87ca-202b95134d1f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:46.240958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04116e18-b46a-4c6c-ab85-e8174fcdd6db admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:46.248346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:46.249090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:46.249467 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:46.249818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] PATH_INFO: `/v3/projects/aa85f358c1454e5284057ed4877b4fef` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:46.251273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa85f358c1454e5284057ed4877b4fef)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:46.253237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:46.346205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1104/2181] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:46 2022] PUT /identity/v3/projects/bd8fd1b9147746bca9e63adaccffbb7f/users/9731bfcc82d246418965fc5774e3a24c/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:46.350090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04116e18-b46a-4c6c-ab85-e8174fcdd6db admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:46.384166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa85f358c1454e5284057ed4877b4fef', 'request_id': 'req-44ffdd04-8070-48a6-b9be-75e2ed10fd22'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:46.391176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa85f358c1454e5284057ed4877b4fef', 'request_id': 'req-44ffdd04-8070-48a6-b9be-75e2ed10fd22'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:46.413538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04116e18-b46a-4c6c-ab85-e8174fcdd6db admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:46.478033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa85f358c1454e5284057ed4877b4fef', 'request_id': 'req-44ffdd04-8070-48a6-b9be-75e2ed10fd22'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:46.479426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6be6be-7da2-474c-a489-90baf222e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:46.480134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be6be-7da2-474c-a489-90baf222e45f admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:46.480457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be6be-7da2-474c-a489-90baf222e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:46.480734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be6be-7da2-474c-a489-90baf222e45f admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:46.481470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6be6be-7da2-474c-a489-90baf222e45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:46.483159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6be6be-7da2-474c-a489-90baf222e45f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:46.489825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] The token cache is being invalidate because project aa85f358c1454e5284057ed4877b4fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:46.490123 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:46.490794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:46.492531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1078/2182] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:46 2022] DELETE /identity/v3/projects/aa85f358c1454e5284057ed4877b4fef => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:46.497338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1105/2183] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:46.498996 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:46.500617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:46.518694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffdd04-8070-48a6-b9be-75e2ed10fd22 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:46.523761 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c47f8a-bbd2-4fc7-b453-3e4d38b13db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:46.525067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47f8a-bbd2-4fc7-b453-3e4d38b13db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:46.525317 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47f8a-bbd2-4fc7-b453-3e4d38b13db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:46.525646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47f8a-bbd2-4fc7-b453-3e4d38b13db9 admin admin] PATH_INFO: `/v3/projects/bd8fd1b9147746bca9e63adaccffbb7f/users/9731bfcc82d246418965fc5774e3a24c/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:46.527959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c47f8a-bbd2-4fc7-b453-3e4d38b13db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8fd1b9147746bca9e63adaccffbb7f, user_id=9731bfcc82d246418965fc5774e3a24c, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:46.530774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c47f8a-bbd2-4fc7-b453-3e4d38b13db9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:46.543597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1079/2184] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:46 2022] PUT /identity/v3/projects/bd8fd1b9147746bca9e63adaccffbb7f/users/9731bfcc82d246418965fc5774e3a24c/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:46.554356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5417d8-9010-4915-a832-a449fef020bf None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:46.554963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5417d8-9010-4915-a832-a449fef020bf None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:46.554963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5417d8-9010-4915-a832-a449fef020bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:46.616862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4d5417d8-9010-4915-a832-a449fef020bf None None] MFA Rules not processed for user `9731bfcc82d246418965fc5774e3a24c`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:46.622301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4d5417d8-9010-4915-a832-a449fef020bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:46.709360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1106/2185] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:46.721243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c47f8a-bbd2-4fc7-b453-3e4d38b13db9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:46.723546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a5c47f8a-bbd2-4fc7-b453-3e4d38b13db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:46.805234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c47f8a-bbd2-4fc7-b453-3e4d38b13db9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:46.809190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1e284-619d-4dd1-894d-78ee43b13e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:46.809819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1e284-619d-4dd1-894d-78ee43b13e12 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:46.810100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1e284-619d-4dd1-894d-78ee43b13e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:46.810381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1e284-619d-4dd1-894d-78ee43b13e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:46.820090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1e284-619d-4dd1-894d-78ee43b13e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:46.822200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1e284-619d-4dd1-894d-78ee43b13e12 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:46.833249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1080/2186] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:46.855068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:47.403298 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5417d8-9010-4915-a832-a449fef020bf None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:47.465657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5417d8-9010-4915-a832-a449fef020bf None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:47.470429 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:47.471292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:47.471749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:47.472441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] PATH_INFO: `/v3/users/a4cde07799954fde908b515a0c154267` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:47.474106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cde07799954fde908b515a0c154267)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:47.476130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:47.558407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1e284-619d-4dd1-894d-78ee43b13e12 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:47.559820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-dbc1e284-619d-4dd1-894d-78ee43b13e12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:47.575109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1e284-619d-4dd1-894d-78ee43b13e12 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:47.579032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:47.579678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:47.579955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:47.580398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] PATH_INFO: `/v3/users/85de091343cc45f9a6989001ef8128d2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:47.581619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85de091343cc45f9a6989001ef8128d2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:47.583535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:47.591177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:47.674314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cde07799954fde908b515a0c154267'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:47.682071 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cde07799954fde908b515a0c154267'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:47.737465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85de091343cc45f9a6989001ef8128d2'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:47.738143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85de091343cc45f9a6989001ef8128d2'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:47.745524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cde07799954fde908b515a0c154267'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:47.746149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cde07799954fde908b515a0c154267'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:47.746764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1a1fbfc9-657d-4883-912b-323802c916cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cde07799954fde908b515a0c154267'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:47.765907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1107/2187] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:47 2022] DELETE /identity/v3/users/a4cde07799954fde908b515a0c154267 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:47.770380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dbbc5-3e21-4f00-918f-5eb6d124e1fe None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:47.770673 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dbbc5-3e21-4f00-918f-5eb6d124e1fe None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:47.770995 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dbbc5-3e21-4f00-918f-5eb6d124e1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:47.793581 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-760dbbc5-3e21-4f00-918f-5eb6d124e1fe None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:47.794834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-760dbbc5-3e21-4f00-918f-5eb6d124e1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:47.861189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85de091343cc45f9a6989001ef8128d2'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:47.869108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1108/2188] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:47.876581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85de091343cc45f9a6989001ef8128d2'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:47.890225 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760dbbc5-3e21-4f00-918f-5eb6d124e1fe None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:47.892939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-760dbbc5-3e21-4f00-918f-5eb6d124e1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:47.902833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-62fbeff9-499a-4f2d-a50e-8e8fce477571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85de091343cc45f9a6989001ef8128d2'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:47.911006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1081/2189] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:47 2022] DELETE /identity/v3/users/85de091343cc45f9a6989001ef8128d2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:47.919082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c52340-8fb6-4e30-93e6-082325951d4a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:47.919373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c52340-8fb6-4e30-93e6-082325951d4a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:47.919817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c52340-8fb6-4e30-93e6-082325951d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:47.942818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-30c52340-8fb6-4e30-93e6-082325951d4a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:47.944488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-30c52340-8fb6-4e30-93e6-082325951d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:47.987286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760dbbc5-3e21-4f00-918f-5eb6d124e1fe None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:48.002621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:48.047882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1082/2190] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:48.062088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c52340-8fb6-4e30-93e6-082325951d4a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:48.063694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-30c52340-8fb6-4e30-93e6-082325951d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:48.131160 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7665ab-f92f-43e3-9b4c-4e2a9e2d3e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:48.137296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7665ab-f92f-43e3-9b4c-4e2a9e2d3e19 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:48.137296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7665ab-f92f-43e3-9b4c-4e2a9e2d3e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:48.137296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7665ab-f92f-43e3-9b4c-4e2a9e2d3e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:48.137296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8a7665ab-f92f-43e3-9b4c-4e2a9e2d3e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:48.148794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7665ab-f92f-43e3-9b4c-4e2a9e2d3e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:48.154414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c52340-8fb6-4e30-93e6-082325951d4a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:48.154563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7665ab-f92f-43e3-9b4c-4e2a9e2d3e19 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:48.158462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ca719-9648-46a5-9429-3da9ce343d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:48.159140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca719-9648-46a5-9429-3da9ce343d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:48.159441 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca719-9648-46a5-9429-3da9ce343d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:48.159724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca719-9648-46a5-9429-3da9ce343d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:48.171495 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ca719-9648-46a5-9429-3da9ce343d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:48.172971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ca719-9648-46a5-9429-3da9ce343d9c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:48.174688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1109/2191] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:48.201424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1083/2192] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:48.371626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc8170-8d9d-4ceb-8a69-ba87c4c55d52 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:48.371913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc8170-8d9d-4ceb-8a69-ba87c4c55d52 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:48.372193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc8170-8d9d-4ceb-8a69-ba87c4c55d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:48.400713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c3dc8170-8d9d-4ceb-8a69-ba87c4c55d52 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:48.402455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c3dc8170-8d9d-4ceb-8a69-ba87c4c55d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:48.479753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1110/2193] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:05:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:48.494764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ca719-9648-46a5-9429-3da9ce343d9c service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:48.496454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a09ca719-9648-46a5-9429-3da9ce343d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:48.587591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ca719-9648-46a5-9429-3da9ce343d9c service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:48.593721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710d324-0e8f-4be6-aa2e-b1bcf4be4c06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:48.594935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710d324-0e8f-4be6-aa2e-b1bcf4be4c06 service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:48.595480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710d324-0e8f-4be6-aa2e-b1bcf4be4c06 service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:48.595964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710d324-0e8f-4be6-aa2e-b1bcf4be4c06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:48.607770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710d324-0e8f-4be6-aa2e-b1bcf4be4c06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:48.609678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710d324-0e8f-4be6-aa2e-b1bcf4be4c06 service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:48.619758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1084/2194] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:05:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:05:48.713257 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc8170-8d9d-4ceb-8a69-ba87c4c55d52 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:48.714753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c3dc8170-8d9d-4ceb-8a69-ba87c4c55d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:48.731708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc8170-8d9d-4ceb-8a69-ba87c4c55d52 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:48.736705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:48.737975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:48.740068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:48.740068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] PATH_INFO: `/v3/projects/0cbb7a347dab48cca12193330381e0cf` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:48.740519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cbb7a347dab48cca12193330381e0cf)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:48.742775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:48.826338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:48.833796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710d324-0e8f-4be6-aa2e-b1bcf4be4c06 service swift] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:48.838562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a710d324-0e8f-4be6-aa2e-b1bcf4be4c06 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:48.884387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710d324-0e8f-4be6-aa2e-b1bcf4be4c06 service swift] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:48.908089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cbb7a347dab48cca12193330381e0cf', 'request_id': 'req-1944937a-dbe9-4d4a-bbde-3a79012e6725'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:48.923052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cbb7a347dab48cca12193330381e0cf', 'request_id': 'req-1944937a-dbe9-4d4a-bbde-3a79012e6725'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:48.938011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cbb7a347dab48cca12193330381e0cf', 'request_id': 'req-1944937a-dbe9-4d4a-bbde-3a79012e6725'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.016141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:49.016929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:49.017365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:49.017706 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] PATH_INFO: `/v3/projects/c3a0155ba92146ea81cf12a4e7d8df13` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:49.017972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] The token cache is being invalidate because project 0cbb7a347dab48cca12193330381e0cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:49.018382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.019197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a0155ba92146ea81cf12a4e7d8df13)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:49.019918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.021685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:49.029064 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1111/2195] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:48 2022] DELETE /identity/v3/projects/0cbb7a347dab48cca12193330381e0cf => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:49.037705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:49.045263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:49.081751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944937a-dbe9-4d4a-bbde-3a79012e6725 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:49.091679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:49.092469 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:49.092921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:49.093332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] PATH_INFO: `/v3/users/3b406e024d664e8a90632ca9bdf74c4f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:49.094907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b406e024d664e8a90632ca9bdf74c4f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:49.100076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:49.146741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a0155ba92146ea81cf12a4e7d8df13', 'request_id': 'req-b14c92c6-007a-478a-b7ff-086ae53c89eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.158004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a0155ba92146ea81cf12a4e7d8df13', 'request_id': 'req-b14c92c6-007a-478a-b7ff-086ae53c89eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.267217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a0155ba92146ea81cf12a4e7d8df13', 'request_id': 'req-b14c92c6-007a-478a-b7ff-086ae53c89eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.286476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] The token cache is being invalidate because project c3a0155ba92146ea81cf12a4e7d8df13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:49.289008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.294483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.298080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1085/2196] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:48 2022] DELETE /identity/v3/projects/c3a0155ba92146ea81cf12a4e7d8df13 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:49.330724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:49.335919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:49.385818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b406e024d664e8a90632ca9bdf74c4f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.403988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b406e024d664e8a90632ca9bdf74c4f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.490521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c92c6-007a-478a-b7ff-086ae53c89eb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:49.498734 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:49.499712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:49.500075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:49.500425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] PATH_INFO: `/v3/users/9731bfcc82d246418965fc5774e3a24c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:49.501887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9731bfcc82d246418965fc5774e3a24c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:49.504136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:49.513654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b406e024d664e8a90632ca9bdf74c4f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.513654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b406e024d664e8a90632ca9bdf74c4f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.513654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b406e024d664e8a90632ca9bdf74c4f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.556791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1112/2197] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:49 2022] DELETE /identity/v3/users/3b406e024d664e8a90632ca9bdf74c4f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:49.824064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9731bfcc82d246418965fc5774e3a24c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.824925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9731bfcc82d246418965fc5774e3a24c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.898463 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:49.900389 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9731bfcc82d246418965fc5774e3a24c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.936393 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9731bfcc82d246418965fc5774e3a24c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.946392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:49.952959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9731bfcc82d246418965fc5774e3a24c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:49.969254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1086/2198] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:49 2022] DELETE /identity/v3/users/9731bfcc82d246418965fc5774e3a24c => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:50.164466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:50.168409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:50.270521 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c666af9-0c71-484e-814b-bd059651b023 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:50.362016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:50.363068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:50.363500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:50.363926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] PATH_INFO: `/v3/projects/8ffcaf094b7c4b8dbfb45b73083f0a3f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:50.365731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffcaf094b7c4b8dbfb45b73083f0a3f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:50.370497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:50.561418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffcaf094b7c4b8dbfb45b73083f0a3f', 'request_id': 'req-f908993a-ce68-43e0-8178-cb9b0bc35aad'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:50.570021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffcaf094b7c4b8dbfb45b73083f0a3f', 'request_id': 'req-f908993a-ce68-43e0-8178-cb9b0bc35aad'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:50.579055 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffcaf094b7c4b8dbfb45b73083f0a3f', 'request_id': 'req-f908993a-ce68-43e0-8178-cb9b0bc35aad'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:50.633190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] The token cache is being invalidate because project 8ffcaf094b7c4b8dbfb45b73083f0a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:50.639617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:50.639617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:50.639617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1113/2199] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:50 2022] DELETE /identity/v3/projects/8ffcaf094b7c4b8dbfb45b73083f0a3f => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:50.642699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:50.644186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:50.671506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b4b6c-6f0e-4e17-ba51-b08ea2cce89c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:50.717873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:50.794970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:50.795696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:50.796105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:50.796451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] PATH_INFO: `/v3/users/71ad5464a69446008ebeb890db553cca` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:50.797809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ad5464a69446008ebeb890db553cca)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:50.800129 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:50.861048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:50.984731 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ad5464a69446008ebeb890db553cca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:50.986269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ad5464a69446008ebeb890db553cca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.071667 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ad5464a69446008ebeb890db553cca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.085502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ad5464a69446008ebeb890db553cca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.092724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-681dd1cd-b50b-44a9-8c94-d358838ded05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ad5464a69446008ebeb890db553cca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.105409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1087/2200] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:50 2022] DELETE /identity/v3/users/71ad5464a69446008ebeb890db553cca => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:51.108272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:51.114957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:51.134789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908993a-ce68-43e0-8178-cb9b0bc35aad admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:51.213357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:51.214024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:51.214310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:51.214589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] PATH_INFO: `/v3/projects/bd8fd1b9147746bca9e63adaccffbb7f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:51.215782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8fd1b9147746bca9e63adaccffbb7f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:51.217751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:51.359516 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8fd1b9147746bca9e63adaccffbb7f', 'request_id': 'req-57cc93a9-63cd-4cb9-8599-f0661bd82643'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.366843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8fd1b9147746bca9e63adaccffbb7f', 'request_id': 'req-57cc93a9-63cd-4cb9-8599-f0661bd82643'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.372830 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8fd1b9147746bca9e63adaccffbb7f', 'request_id': 'req-57cc93a9-63cd-4cb9-8599-f0661bd82643'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.467714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] The token cache is being invalidate because project bd8fd1b9147746bca9e63adaccffbb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:51.468010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.468666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.471236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1114/2201] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:51 2022] DELETE /identity/v3/projects/bd8fd1b9147746bca9e63adaccffbb7f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:51.475981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40776334-fc8c-4d9e-bc1e-36e6df781798 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:51.481661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40776334-fc8c-4d9e-bc1e-36e6df781798 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:51.481661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40776334-fc8c-4d9e-bc1e-36e6df781798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:51.535214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-40776334-fc8c-4d9e-bc1e-36e6df781798 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:51.536519 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-40776334-fc8c-4d9e-bc1e-36e6df781798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:51.620043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:51.621804 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:51.625896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1088/2202] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:51.638185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96898e57-0588-4c0c-b43a-660278303664 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:51.638475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96898e57-0588-4c0c-b43a-660278303664 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:51.638816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96898e57-0588-4c0c-b43a-660278303664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:51.642771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc93a9-63cd-4cb9-8599-f0661bd82643 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:51.667970 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:51.668935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:51.670159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:51.670493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] PATH_INFO: `/v3/projects/9a316a76d4d0410eaee0afefdcfcc090` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:51.672297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a316a76d4d0410eaee0afefdcfcc090)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:51.676552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:51.678623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-96898e57-0588-4c0c-b43a-660278303664 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:51.680847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-96898e57-0588-4c0c-b43a-660278303664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:51.714669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1089/2203] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:51.719064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96898e57-0588-4c0c-b43a-660278303664 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:51.738100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96898e57-0588-4c0c-b43a-660278303664 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:51.752904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c3844-0135-4b1e-acce-f0018f1020cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:51.753681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c3844-0135-4b1e-acce-f0018f1020cf admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:51.754064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c3844-0135-4b1e-acce-f0018f1020cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:51.754435 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c3844-0135-4b1e-acce-f0018f1020cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:51.755508 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c3844-0135-4b1e-acce-f0018f1020cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:51.755974 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c3844-0135-4b1e-acce-f0018f1020cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:51.757977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c3844-0135-4b1e-acce-f0018f1020cf admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:51.775232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1090/2204] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:05:51.779809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c3844-0135-4b1e-acce-f0018f1020cf admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:51.795539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c3844-0135-4b1e-acce-f0018f1020cf admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:51.801445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d5912-136e-47c5-b1a9-2b372d2a780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:51.802178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d5912-136e-47c5-b1a9-2b372d2a780f admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:51.804282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d5912-136e-47c5-b1a9-2b372d2a780f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:51.804861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d5912-136e-47c5-b1a9-2b372d2a780f admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:51.806336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d5912-136e-47c5-b1a9-2b372d2a780f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:51.809688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d5912-136e-47c5-b1a9-2b372d2a780f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:51.820241 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a316a76d4d0410eaee0afefdcfcc090', 'request_id': 'req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.832457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a316a76d4d0410eaee0afefdcfcc090', 'request_id': 'req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.840057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a316a76d4d0410eaee0afefdcfcc090', 'request_id': 'req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.922154 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1091/2205] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:51 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:51.923767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d5912-136e-47c5-b1a9-2b372d2a780f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:51.950321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] The token cache is being invalidate because project 9a316a76d4d0410eaee0afefdcfcc090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:51.950657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.951326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6807bd77-49f5-4f23-a3b8-b9b1f236faa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:51.952907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1115/2206] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:51 2022] DELETE /identity/v3/projects/9a316a76d4d0410eaee0afefdcfcc090 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:51.960191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef18f2-61a4-4c57-9a3f-94b9e91f775f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:51.960538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef18f2-61a4-4c57-9a3f-94b9e91f775f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:51.960916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef18f2-61a4-4c57-9a3f-94b9e91f775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:51.991687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-98ef18f2-61a4-4c57-9a3f-94b9e91f775f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:51.993650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-98ef18f2-61a4-4c57-9a3f-94b9e91f775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:52.000195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:52.004557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d5912-136e-47c5-b1a9-2b372d2a780f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.005549 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1116/2207] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:52.009620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73e49-2fcc-4c05-8847-a37af3c31472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.010531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73e49-2fcc-4c05-8847-a37af3c31472 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.010813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73e49-2fcc-4c05-8847-a37af3c31472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.011091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73e49-2fcc-4c05-8847-a37af3c31472 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.011761 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73e49-2fcc-4c05-8847-a37af3c31472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.013920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73e49-2fcc-4c05-8847-a37af3c31472 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.015758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c37593-906f-4b15-b6c5-179ada614449 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.016053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c37593-906f-4b15-b6c5-179ada614449 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.016336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c37593-906f-4b15-b6c5-179ada614449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.065199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-31c37593-906f-4b15-b6c5-179ada614449 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:52.066621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-31c37593-906f-4b15-b6c5-179ada614449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:52.091692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1117/2208] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:52.093522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1092/2209] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:51 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:05:52.095003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c37593-906f-4b15-b6c5-179ada614449 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.097871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73e49-2fcc-4c05-8847-a37af3c31472 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.100678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5bf73e49-2fcc-4c05-8847-a37af3c31472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:52.117203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c37593-906f-4b15-b6c5-179ada614449 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.123978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae92786-c70e-440b-a549-ae5e4ae300a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.124671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae92786-c70e-440b-a549-ae5e4ae300a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.124960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae92786-c70e-440b-a549-ae5e4ae300a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.125407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae92786-c70e-440b-a549-ae5e4ae300a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.126191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae92786-c70e-440b-a549-ae5e4ae300a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:52.126500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae92786-c70e-440b-a549-ae5e4ae300a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.128905 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae92786-c70e-440b-a549-ae5e4ae300a8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.137839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73e49-2fcc-4c05-8847-a37af3c31472 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.144201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c52cd-dc34-48a2-9e6d-e84223bff128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.145192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c52cd-dc34-48a2-9e6d-e84223bff128 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.145678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c52cd-dc34-48a2-9e6d-e84223bff128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.146180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c52cd-dc34-48a2-9e6d-e84223bff128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.147102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1118/2210] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:52.147703 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c52cd-dc34-48a2-9e6d-e84223bff128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.148078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae92786-c70e-440b-a549-ae5e4ae300a8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.150581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c52cd-dc34-48a2-9e6d-e84223bff128 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.163828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1093/2211] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:52.169052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c52cd-dc34-48a2-9e6d-e84223bff128 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.172431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae92786-c70e-440b-a549-ae5e4ae300a8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.181716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a60c6-0a44-4342-807a-2921e3fa80df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.182360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a60c6-0a44-4342-807a-2921e3fa80df admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.182641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a60c6-0a44-4342-807a-2921e3fa80df admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.182916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a60c6-0a44-4342-807a-2921e3fa80df admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.183365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c52cd-dc34-48a2-9e6d-e84223bff128 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.183598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a60c6-0a44-4342-807a-2921e3fa80df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.185620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a60c6-0a44-4342-807a-2921e3fa80df admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.189722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58759ca-937d-43d6-8506-64ca085880c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.190644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58759ca-937d-43d6-8506-64ca085880c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.191125 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58759ca-937d-43d6-8506-64ca085880c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.191596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58759ca-937d-43d6-8506-64ca085880c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.192521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58759ca-937d-43d6-8506-64ca085880c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.194604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58759ca-937d-43d6-8506-64ca085880c6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.207036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1094/2212] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:52.213693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58759ca-937d-43d6-8506-64ca085880c6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.235526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58759ca-937d-43d6-8506-64ca085880c6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.249722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb5dd-9545-4c5d-9e48-7a798c98635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.251831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb5dd-9545-4c5d-9e48-7a798c98635e admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.252805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb5dd-9545-4c5d-9e48-7a798c98635e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.253185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb5dd-9545-4c5d-9e48-7a798c98635e admin admin] PATH_INFO: `/v3/projects/fa91486048854a8287c65aea8ba3e78b/users/86373317c9cc41b8b4f63a3e312759d7/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.288014 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb5dd-9545-4c5d-9e48-7a798c98635e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa91486048854a8287c65aea8ba3e78b, user_id=86373317c9cc41b8b4f63a3e312759d7, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.291773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb5dd-9545-4c5d-9e48-7a798c98635e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.311509 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1119/2213] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:52 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:52.317311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a60c6-0a44-4342-807a-2921e3fa80df admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.329319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:52.411296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1095/2214] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:52 2022] PUT /identity/v3/projects/fa91486048854a8287c65aea8ba3e78b/users/86373317c9cc41b8b4f63a3e312759d7/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:52.413835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51f8ff-043e-4059-a6fc-f3d5b762fa7e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.414319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51f8ff-043e-4059-a6fc-f3d5b762fa7e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.415385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51f8ff-043e-4059-a6fc-f3d5b762fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.492188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ce51f8ff-043e-4059-a6fc-f3d5b762fa7e None None] MFA Rules not processed for user `86373317c9cc41b8b4f63a3e312759d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:52.493859 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ce51f8ff-043e-4059-a6fc-f3d5b762fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:52.500134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a60c6-0a44-4342-807a-2921e3fa80df admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.592689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1096/2215] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:52.592896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c687839-7fe9-4f64-92e1-e03acaf7df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.592896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c687839-7fe9-4f64-92e1-e03acaf7df96 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.592896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c687839-7fe9-4f64-92e1-e03acaf7df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.592896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c687839-7fe9-4f64-92e1-e03acaf7df96 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.593570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c687839-7fe9-4f64-92e1-e03acaf7df96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.595899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c687839-7fe9-4f64-92e1-e03acaf7df96 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.596039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51f8ff-043e-4059-a6fc-f3d5b762fa7e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.608697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51f8ff-043e-4059-a6fc-f3d5b762fa7e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.613410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039a52-f957-4650-8da6-9100f38e7811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.614035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039a52-f957-4650-8da6-9100f38e7811 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.614312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039a52-f957-4650-8da6-9100f38e7811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.614588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039a52-f957-4650-8da6-9100f38e7811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.615252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8039a52-f957-4650-8da6-9100f38e7811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.617539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8039a52-f957-4650-8da6-9100f38e7811 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.721043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1120/2216] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:52 2022] POST /identity/v3/users => generated 291 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:52.724675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c687839-7fe9-4f64-92e1-e03acaf7df96 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.724811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1097/2217] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:52 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:52.730065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039a52-f957-4650-8da6-9100f38e7811 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.740260 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:52.744620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c687839-7fe9-4f64-92e1-e03acaf7df96 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.828333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:52.856771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039a52-f957-4650-8da6-9100f38e7811 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.861568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862c2e7-5c69-47a6-9190-570cdb77d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.862208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862c2e7-5c69-47a6-9190-570cdb77d2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.862496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862c2e7-5c69-47a6-9190-570cdb77d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.863175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862c2e7-5c69-47a6-9190-570cdb77d2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.863476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862c2e7-5c69-47a6-9190-570cdb77d2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.865136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862c2e7-5c69-47a6-9190-570cdb77d2b5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.873011 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641b94f-de6c-45c9-8b32-8e572b8b7e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.873894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641b94f-de6c-45c9-8b32-8e572b8b7e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.874280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641b94f-de6c-45c9-8b32-8e572b8b7e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.874566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641b94f-de6c-45c9-8b32-8e572b8b7e64 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.875353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641b94f-de6c-45c9-8b32-8e572b8b7e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.878537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641b94f-de6c-45c9-8b32-8e572b8b7e64 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.880211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1121/2218] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:52.886141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862c2e7-5c69-47a6-9190-570cdb77d2b5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.902666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862c2e7-5c69-47a6-9190-570cdb77d2b5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.908276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26378199-f7be-454b-8cdd-1ef69f6f03e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.909146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26378199-f7be-454b-8cdd-1ef69f6f03e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.909447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26378199-f7be-454b-8cdd-1ef69f6f03e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.909792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26378199-f7be-454b-8cdd-1ef69f6f03e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.910419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26378199-f7be-454b-8cdd-1ef69f6f03e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.912072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26378199-f7be-454b-8cdd-1ef69f6f03e1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:52.925560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1122/2219] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:52.938412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26378199-f7be-454b-8cdd-1ef69f6f03e1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:52.949112 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26378199-f7be-454b-8cdd-1ef69f6f03e1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:52.955050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfeaca-84eb-426e-b7bf-5a60f07328ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:52.955897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfeaca-84eb-426e-b7bf-5a60f07328ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:52.956185 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfeaca-84eb-426e-b7bf-5a60f07328ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:52.956463 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfeaca-84eb-426e-b7bf-5a60f07328ce admin admin] PATH_INFO: `/v3/projects/e6a6da8a0d1c4275ab9f7afcb725e59f/users/efa64eb1e46e4358ae2fb769359f66f8/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:52.983249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfeaca-84eb-426e-b7bf-5a60f07328ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a6da8a0d1c4275ab9f7afcb725e59f, user_id=efa64eb1e46e4358ae2fb769359f66f8, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:52.986761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfeaca-84eb-426e-b7bf-5a60f07328ce admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:53.003580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1098/2220] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:52 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:53.005093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641b94f-de6c-45c9-8b32-8e572b8b7e64 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:53.016857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641b94f-de6c-45c9-8b32-8e572b8b7e64 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:53.024797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b426b3-2f35-4430-9561-f0e65d934454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:53.025694 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b426b3-2f35-4430-9561-f0e65d934454 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:53.026168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b426b3-2f35-4430-9561-f0e65d934454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:53.026920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b426b3-2f35-4430-9561-f0e65d934454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:53.033973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b426b3-2f35-4430-9561-f0e65d934454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:53.033973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b426b3-2f35-4430-9561-f0e65d934454 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:53.061971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1099/2221] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:53.063475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b426b3-2f35-4430-9561-f0e65d934454 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:53.081252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b426b3-2f35-4430-9561-f0e65d934454 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:53.084174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1123/2222] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:52 2022] PUT /identity/v3/projects/e6a6da8a0d1c4275ab9f7afcb725e59f/users/efa64eb1e46e4358ae2fb769359f66f8/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:53.095625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d315b-c3f0-4d05-90ca-14857278dc9e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:53.095973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d315b-c3f0-4d05-90ca-14857278dc9e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:53.096853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d315b-c3f0-4d05-90ca-14857278dc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:53.159873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7f2d315b-c3f0-4d05-90ca-14857278dc9e None None] MFA Rules not processed for user `efa64eb1e46e4358ae2fb769359f66f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:53.160943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7f2d315b-c3f0-4d05-90ca-14857278dc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:53.190574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ea904-b4c9-4da3-8d36-eef8879c78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:53.191500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ea904-b4c9-4da3-8d36-eef8879c78c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:53.191780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ea904-b4c9-4da3-8d36-eef8879c78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:53.192064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ea904-b4c9-4da3-8d36-eef8879c78c0 admin admin] PATH_INFO: `/v3/projects/67124e3b43aa4681a115593cb0cb84c4/users/2b3cbebff84c4e7a93864451fdfa915a/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:53.225032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ea904-b4c9-4da3-8d36-eef8879c78c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67124e3b43aa4681a115593cb0cb84c4, user_id=2b3cbebff84c4e7a93864451fdfa915a, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:53.228236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ea904-b4c9-4da3-8d36-eef8879c78c0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:53.254480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1124/2223] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:05:53.270876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d315b-c3f0-4d05-90ca-14857278dc9e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:53.272569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7f2d315b-c3f0-4d05-90ca-14857278dc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:53.292635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d315b-c3f0-4d05-90ca-14857278dc9e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:53.297966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:53.298937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:53.299277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:53.299556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] PATH_INFO: `/v3/users/78aeeaa628d24effb7cc63ee5faecc1f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:53.305602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78aeeaa628d24effb7cc63ee5faecc1f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:53.305602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:53.360154 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1100/2224] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:53 2022] PUT /identity/v3/projects/67124e3b43aa4681a115593cb0cb84c4/users/2b3cbebff84c4e7a93864451fdfa915a/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:53.361349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ea904-b4c9-4da3-8d36-eef8879c78c0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:53.369663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3b6ea904-b4c9-4da3-8d36-eef8879c78c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:53.461820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ea904-b4c9-4da3-8d36-eef8879c78c0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:53.479214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24f83-6957-430c-bf97-46f4c5191b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:53.479214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24f83-6957-430c-bf97-46f4c5191b46 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:53.479214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24f83-6957-430c-bf97-46f4c5191b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:53.479214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24f83-6957-430c-bf97-46f4c5191b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:53.582374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24f83-6957-430c-bf97-46f4c5191b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:53.584188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24f83-6957-430c-bf97-46f4c5191b46 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:53.596052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1101/2225] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:53.597651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24f83-6957-430c-bf97-46f4c5191b46 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:53.781679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24f83-6957-430c-bf97-46f4c5191b46 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:53.781679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde52a-04ca-4f3b-9b5f-d8fe35344c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:53.781679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde52a-04ca-4f3b-9b5f-d8fe35344c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:53.781679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde52a-04ca-4f3b-9b5f-d8fe35344c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:53.782749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde52a-04ca-4f3b-9b5f-d8fe35344c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:53.782749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde52a-04ca-4f3b-9b5f-d8fe35344c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:53.782749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde52a-04ca-4f3b-9b5f-d8fe35344c27 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:53.782749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1102/2226] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:53.782749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde52a-04ca-4f3b-9b5f-d8fe35344c27 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:53.782749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde52a-04ca-4f3b-9b5f-d8fe35344c27 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:53.783342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:53.783342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:53.783342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:53.783342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] PATH_INFO: `/v3/users/efa64eb1e46e4358ae2fb769359f66f8` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:53.783745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa64eb1e46e4358ae2fb769359f66f8)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:53.783745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:54.033282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:54.177443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78aeeaa628d24effb7cc63ee5faecc1f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:54.185661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78aeeaa628d24effb7cc63ee5faecc1f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:54.208679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa64eb1e46e4358ae2fb769359f66f8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:54.209382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa64eb1e46e4358ae2fb769359f66f8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:54.289864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:54.291246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78aeeaa628d24effb7cc63ee5faecc1f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:54.292158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78aeeaa628d24effb7cc63ee5faecc1f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:54.293154 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78aeeaa628d24effb7cc63ee5faecc1f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:54.314471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1125/2227] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:53 2022] DELETE /identity/v3/users/78aeeaa628d24effb7cc63ee5faecc1f => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:54.315708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:54.322014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:54.364018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa64eb1e46e4358ae2fb769359f66f8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:54.397374 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa64eb1e46e4358ae2fb769359f66f8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:54.413582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6967d91e-3936-4d1c-8ea4-b63f380a1741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa64eb1e46e4358ae2fb769359f66f8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:54.420446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1103/2228] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:53 2022] DELETE /identity/v3/users/efa64eb1e46e4358ae2fb769359f66f8 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:54.426443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cfc9b-9d10-42f9-ad68-246a81f8cc10 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:54.426443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cfc9b-9d10-42f9-ad68-246a81f8cc10 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:54.426443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cfc9b-9d10-42f9-ad68-246a81f8cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:54.433782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cea20f-6bf6-4a61-b155-15193b74cc17 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:54.456493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8b2cfc9b-9d10-42f9-ad68-246a81f8cc10 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:54.459318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8b2cfc9b-9d10-42f9-ad68-246a81f8cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:54.567066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e55756-4754-4470-ba34-309f5f126ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:54.569638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e55756-4754-4470-ba34-309f5f126ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:54.569926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e55756-4754-4470-ba34-309f5f126ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:54.570210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e55756-4754-4470-ba34-309f5f126ebc admin admin] PATH_INFO: `/v3/projects/67124e3b43aa4681a115593cb0cb84c4/users/2b3cbebff84c4e7a93864451fdfa915a/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:54.574537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1104/2229] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:54.576667 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5510-ec74-4daf-a2a8-ac0f3c5ba6f1 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:54.580383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e55756-4754-4470-ba34-309f5f126ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=67124e3b43aa4681a115593cb0cb84c4, user_id=2b3cbebff84c4e7a93864451fdfa915a, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:54.583669 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e55756-4754-4470-ba34-309f5f126ebc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:54.587886 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5510-ec74-4daf-a2a8-ac0f3c5ba6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:54.587886 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5510-ec74-4daf-a2a8-ac0f3c5ba6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:54.599611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1126/2230] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:54 2022] PUT /identity/v3/projects/67124e3b43aa4681a115593cb0cb84c4/users/2b3cbebff84c4e7a93864451fdfa915a/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:54.606422 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e55756-4754-4470-ba34-309f5f126ebc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:54.608359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-51e55756-4754-4470-ba34-309f5f126ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:54.618144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3d7a5510-ec74-4daf-a2a8-ac0f3c5ba6f1 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:54.619498 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3d7a5510-ec74-4daf-a2a8-ac0f3c5ba6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:54.694652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:54.722931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e55756-4754-4470-ba34-309f5f126ebc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:54.748887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b0622-de1a-4ed4-af85-c9b4a4fa28cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:54.748887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b0622-de1a-4ed4-af85-c9b4a4fa28cc service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:54.748887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b0622-de1a-4ed4-af85-c9b4a4fa28cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:54.748887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b0622-de1a-4ed4-af85-c9b4a4fa28cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:54.749894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1105/2231] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:54.749894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efea75-6acb-447d-ba0b-822f98f8ae23 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:54.749894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efea75-6acb-447d-ba0b-822f98f8ae23 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:54.749894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efea75-6acb-447d-ba0b-822f98f8ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:54.750337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b0622-de1a-4ed4-af85-c9b4a4fa28cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:54.750337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b0622-de1a-4ed4-af85-c9b4a4fa28cc service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:54.764781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1127/2232] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:54.765737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b0622-de1a-4ed4-af85-c9b4a4fa28cc service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:54.767881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3b9b0622-de1a-4ed4-af85-c9b4a4fa28cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:54.779810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b0622-de1a-4ed4-af85-c9b4a4fa28cc service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:54.784768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c5efea75-6acb-447d-ba0b-822f98f8ae23 None None] MFA Rules not processed for user `2b3cbebff84c4e7a93864451fdfa915a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:54.790603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61ed70-6b30-4f63-9cc8-bb339217cc11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:54.790603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61ed70-6b30-4f63-9cc8-bb339217cc11 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:54.790603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61ed70-6b30-4f63-9cc8-bb339217cc11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:54.790603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61ed70-6b30-4f63-9cc8-bb339217cc11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:54.791270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c5efea75-6acb-447d-ba0b-822f98f8ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:54.799767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61ed70-6b30-4f63-9cc8-bb339217cc11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:54.799767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61ed70-6b30-4f63-9cc8-bb339217cc11 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:54.810564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1128/2233] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:54.819807 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:54.899004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1106/2234] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:54.913420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61ed70-6b30-4f63-9cc8-bb339217cc11 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:54.915848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7c61ed70-6b30-4f63-9cc8-bb339217cc11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:55.010418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61ed70-6b30-4f63-9cc8-bb339217cc11 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:55.018559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156a81-a43e-4e79-8901-60eeff86a265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:55.029314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156a81-a43e-4e79-8901-60eeff86a265 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:55.029314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156a81-a43e-4e79-8901-60eeff86a265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:55.029314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156a81-a43e-4e79-8901-60eeff86a265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:55.041960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156a81-a43e-4e79-8901-60eeff86a265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:55.043615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156a81-a43e-4e79-8901-60eeff86a265 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:55.068872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1129/2235] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:55.157644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:55.301539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efea75-6acb-447d-ba0b-822f98f8ae23 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:55.312092 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efea75-6acb-447d-ba0b-822f98f8ae23 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:55.322828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25206983-3189-4f12-a7b9-0d12e815b852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:55.323535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206983-3189-4f12-a7b9-0d12e815b852 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:55.323823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206983-3189-4f12-a7b9-0d12e815b852 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:55.324099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206983-3189-4f12-a7b9-0d12e815b852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:55.330354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-25206983-3189-4f12-a7b9-0d12e815b852 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:55.401911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156a81-a43e-4e79-8901-60eeff86a265 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:55.404189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-25156a81-a43e-4e79-8901-60eeff86a265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:55.422822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25206983-3189-4f12-a7b9-0d12e815b852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:55.425495 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25206983-3189-4f12-a7b9-0d12e815b852 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:55.439072 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1107/2236] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:55.445524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156a81-a43e-4e79-8901-60eeff86a265 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:55.461793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:55.461793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:55.461793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:55.461793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] PATH_INFO: `/v3/projects/e6a6da8a0d1c4275ab9f7afcb725e59f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:55.463462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a6da8a0d1c4275ab9f7afcb725e59f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:55.468304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:55.639648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a6da8a0d1c4275ab9f7afcb725e59f', 'request_id': 'req-a85daaaf-d7c2-4200-b66b-629a86214645'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:55.650799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a6da8a0d1c4275ab9f7afcb725e59f', 'request_id': 'req-a85daaaf-d7c2-4200-b66b-629a86214645'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:55.661069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a6da8a0d1c4275ab9f7afcb725e59f', 'request_id': 'req-a85daaaf-d7c2-4200-b66b-629a86214645'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:55.754935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25206983-3189-4f12-a7b9-0d12e815b852 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:55.757501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-25206983-3189-4f12-a7b9-0d12e815b852 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:55.781563 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25206983-3189-4f12-a7b9-0d12e815b852 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:55.798632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:55.810403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] The token cache is being invalidate because project e6a6da8a0d1c4275ab9f7afcb725e59f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:55.810952 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:55.812104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a85daaaf-d7c2-4200-b66b-629a86214645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:55.816683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1130/2237] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:55 2022] DELETE /identity/v3/projects/e6a6da8a0d1c4275ab9f7afcb725e59f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:55.823576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d36082-9f4a-4fd8-9cb8-e9e9e38bca12 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:55.824614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d36082-9f4a-4fd8-9cb8-e9e9e38bca12 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:55.825059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d36082-9f4a-4fd8-9cb8-e9e9e38bca12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:55.865213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d4d36082-9f4a-4fd8-9cb8-e9e9e38bca12 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:55.866566 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d4d36082-9f4a-4fd8-9cb8-e9e9e38bca12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:55.893322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:55.927666 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:55.928321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:55.928642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:55.928919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] PATH_INFO: `/v3/projects/8959dcc710404fdba213a83e399db97e` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:55.930823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8959dcc710404fdba213a83e399db97e)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:55.932724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:55.996033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1131/2238] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:56.004415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2eadf-8dcb-4f9f-b279-9123ba336538 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:56.004758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2eadf-8dcb-4f9f-b279-9123ba336538 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:56.005039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2eadf-8dcb-4f9f-b279-9123ba336538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:56.041086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e5d2eadf-8dcb-4f9f-b279-9123ba336538 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:56.046383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e5d2eadf-8dcb-4f9f-b279-9123ba336538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:56.063007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1132/2239] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:56.069058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2eadf-8dcb-4f9f-b279-9123ba336538 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:56.085705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2eadf-8dcb-4f9f-b279-9123ba336538 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:56.101347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8959dcc710404fdba213a83e399db97e', 'request_id': 'req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.120848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8959dcc710404fdba213a83e399db97e', 'request_id': 'req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.244110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8959dcc710404fdba213a83e399db97e', 'request_id': 'req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.256827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9a019-e260-4478-aed7-68e1b4a10b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:56.257909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9a019-e260-4478-aed7-68e1b4a10b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:56.258305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9a019-e260-4478-aed7-68e1b4a10b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:56.258727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9a019-e260-4478-aed7-68e1b4a10b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:56.259833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9a019-e260-4478-aed7-68e1b4a10b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:56.260210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9a019-e260-4478-aed7-68e1b4a10b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:56.262525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9a019-e260-4478-aed7-68e1b4a10b1a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:56.267658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] The token cache is being invalidate because project 8959dcc710404fdba213a83e399db97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:56.267958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.268682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.273201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1108/2240] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:55 2022] DELETE /identity/v3/projects/8959dcc710404fdba213a83e399db97e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:56.275855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:56.283456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:56.294632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1133/2241] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:56.296337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9a019-e260-4478-aed7-68e1b4a10b1a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:56.300609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fdd9a019-e260-4478-aed7-68e1b4a10b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:56.339650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d953c5-97e8-4583-8c4e-ea6ee8ae064c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:56.347561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9a019-e260-4478-aed7-68e1b4a10b1a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:56.355220 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:56.355927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:56.356214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:56.357978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] PATH_INFO: `/v3/users/a2613fb3f12a47e3ab9f0232db9f0d38` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:56.361671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2613fb3f12a47e3ab9f0232db9f0d38)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:56.363426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b805db-75ba-4c0e-a3ae-818c8ca2d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:56.365082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b805db-75ba-4c0e-a3ae-818c8ca2d2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:56.366308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b805db-75ba-4c0e-a3ae-818c8ca2d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:56.367356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b805db-75ba-4c0e-a3ae-818c8ca2d2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:56.368803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:56.369324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b805db-75ba-4c0e-a3ae-818c8ca2d2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:56.373496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b805db-75ba-4c0e-a3ae-818c8ca2d2f7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:56.519914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1134/2242] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:56 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:56.520855 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b805db-75ba-4c0e-a3ae-818c8ca2d2f7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:56.525099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-71b805db-75ba-4c0e-a3ae-818c8ca2d2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:56.631841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b805db-75ba-4c0e-a3ae-818c8ca2d2f7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:56.642597 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:56.644743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:56.645229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:56.645785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] PATH_INFO: `/v3/users/86373317c9cc41b8b4f63a3e312759d7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:56.647132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] RBAC: Authorizing `identity:delete_user(user_id=86373317c9cc41b8b4f63a3e312759d7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:56.650027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:56.769173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2613fb3f12a47e3ab9f0232db9f0d38'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.769849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2613fb3f12a47e3ab9f0232db9f0d38'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.854346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2613fb3f12a47e3ab9f0232db9f0d38'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.885873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2613fb3f12a47e3ab9f0232db9f0d38'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.893843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2613fb3f12a47e3ab9f0232db9f0d38'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.914209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1109/2243] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:56 2022] DELETE /identity/v3/users/a2613fb3f12a47e3ab9f0232db9f0d38 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:56.923994 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:56.926825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:56.939718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86373317c9cc41b8b4f63a3e312759d7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:56.958873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86373317c9cc41b8b4f63a3e312759d7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:57.038018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2838a-cd46-42d4-8317-7f8dc63ad37e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:57.044624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff754971-b566-470a-ac53-e44c0b68bffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:57.045397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff754971-b566-470a-ac53-e44c0b68bffc admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:57.045802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff754971-b566-470a-ac53-e44c0b68bffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:57.046127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff754971-b566-470a-ac53-e44c0b68bffc admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:57.046798 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff754971-b566-470a-ac53-e44c0b68bffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:57.048823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff754971-b566-470a-ac53-e44c0b68bffc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:57.061982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86373317c9cc41b8b4f63a3e312759d7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:57.064926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86373317c9cc41b8b4f63a3e312759d7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:57.065821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db6caa58-4d0e-40ee-8988-d6b41ead217b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86373317c9cc41b8b4f63a3e312759d7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:57.088271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1135/2244] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:56 2022] DELETE /identity/v3/users/86373317c9cc41b8b4f63a3e312759d7 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:57.092963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734630d-f777-474b-b9a9-f23add1ec862 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:57.093351 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734630d-f777-474b-b9a9-f23add1ec862 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:57.093728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734630d-f777-474b-b9a9-f23add1ec862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:57.114749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e734630d-f777-474b-b9a9-f23add1ec862 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:57.116145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e734630d-f777-474b-b9a9-f23add1ec862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:57.197105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1136/2245] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:57.201688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1110/2246] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:56 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:57.205738 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734630d-f777-474b-b9a9-f23add1ec862 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:57.207939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e734630d-f777-474b-b9a9-f23add1ec862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:57.210304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff754971-b566-470a-ac53-e44c0b68bffc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:57.217669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ff754971-b566-470a-ac53-e44c0b68bffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:57.238107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734630d-f777-474b-b9a9-f23add1ec862 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:57.263278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a803-9b94-4ec5-981c-f045748cc404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:57.265409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a803-9b94-4ec5-981c-f045748cc404 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:57.265966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a803-9b94-4ec5-981c-f045748cc404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:57.266410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a803-9b94-4ec5-981c-f045748cc404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:57.267620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5a803-9b94-4ec5-981c-f045748cc404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:57.269616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5a803-9b94-4ec5-981c-f045748cc404 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:57.283766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1137/2247] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:57.298920 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a803-9b94-4ec5-981c-f045748cc404 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:57.324523 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a803-9b94-4ec5-981c-f045748cc404 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:57.343320 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59685175-0340-480c-abd2-ae16cf887000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:57.344737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59685175-0340-480c-abd2-ae16cf887000 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:57.345056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59685175-0340-480c-abd2-ae16cf887000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:57.346628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59685175-0340-480c-abd2-ae16cf887000 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:57.349080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59685175-0340-480c-abd2-ae16cf887000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:57.351149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff754971-b566-470a-ac53-e44c0b68bffc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:57.355477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59685175-0340-480c-abd2-ae16cf887000 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:57.374819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1138/2248] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:57.391066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59685175-0340-480c-abd2-ae16cf887000 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:57.412272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59685175-0340-480c-abd2-ae16cf887000 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:57.422349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27261e3c-f6ff-497e-b840-9b90ac7d52c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:57.423117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27261e3c-f6ff-497e-b840-9b90ac7d52c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:57.423400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27261e3c-f6ff-497e-b840-9b90ac7d52c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:57.423813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27261e3c-f6ff-497e-b840-9b90ac7d52c3 admin admin] PATH_INFO: `/v3/projects/95c9f01eff194f05a2c62da2da7c1bb9/users/ba2471cbb40b4345bfcf105334982df7/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:57.460523 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27261e3c-f6ff-497e-b840-9b90ac7d52c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c9f01eff194f05a2c62da2da7c1bb9, user_id=ba2471cbb40b4345bfcf105334982df7, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:57.460750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c9b2e-5000-400b-9328-f51b82ee13f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:57.462164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c9b2e-5000-400b-9328-f51b82ee13f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:57.462747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c9b2e-5000-400b-9328-f51b82ee13f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:57.463257 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c9b2e-5000-400b-9328-f51b82ee13f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:57.468481 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27261e3c-f6ff-497e-b840-9b90ac7d52c3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:57.484706 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c9b2e-5000-400b-9328-f51b82ee13f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:57.486226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c9b2e-5000-400b-9328-f51b82ee13f6 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:57.499668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1111/2249] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:57.620353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1139/2250] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:57 2022] PUT /identity/v3/projects/95c9f01eff194f05a2c62da2da7c1bb9/users/ba2471cbb40b4345bfcf105334982df7/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:57.625310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7723be1-715a-44f1-9a46-414660dcf4f8 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:57.626454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7723be1-715a-44f1-9a46-414660dcf4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:57.626454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7723be1-715a-44f1-9a46-414660dcf4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:57.691103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b7723be1-715a-44f1-9a46-414660dcf4f8 None None] MFA Rules not processed for user `ba2471cbb40b4345bfcf105334982df7`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:57.692382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b7723be1-715a-44f1-9a46-414660dcf4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:57.753249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:57.797437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:57.819959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1112/2251] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:57.822961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27261e3c-f6ff-497e-b840-9b90ac7d52c3 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:57.869550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7723be1-715a-44f1-9a46-414660dcf4f8 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:57.875801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b7723be1-715a-44f1-9a46-414660dcf4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:57.989938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7723be1-715a-44f1-9a46-414660dcf4f8 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:57.998013 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:57.998624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27261e3c-f6ff-497e-b840-9b90ac7d52c3 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:57.999063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:57.999572 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.000068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] PATH_INFO: `/v3/projects/b9464ef64de249a6b1ce01865c5d7bb8` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.001462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9464ef64de249a6b1ce01865c5d7bb8)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:58.003679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:58.015505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e00f-2daf-4488-aa2a-8e269e54278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:58.016197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e00f-2daf-4488-aa2a-8e269e54278b admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:58.016423 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e00f-2daf-4488-aa2a-8e269e54278b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.016698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e00f-2daf-4488-aa2a-8e269e54278b admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.017660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4e00f-2daf-4488-aa2a-8e269e54278b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:58.019973 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4e00f-2daf-4488-aa2a-8e269e54278b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:58.121791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1140/2252] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:57 2022] POST /identity/v3/projects => generated 383 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:58.126029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e00f-2daf-4488-aa2a-8e269e54278b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:58.216093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9464ef64de249a6b1ce01865c5d7bb8', 'request_id': 'req-91dcb0af-1953-4456-a78c-1f1847dd9c77'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:58.229876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9464ef64de249a6b1ce01865c5d7bb8', 'request_id': 'req-91dcb0af-1953-4456-a78c-1f1847dd9c77'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:58.257600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e00f-2daf-4488-aa2a-8e269e54278b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:58.327680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442f23b-8894-4585-bf12-55ed3ef49594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:58.328616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442f23b-8894-4585-bf12-55ed3ef49594 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:58.329088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442f23b-8894-4585-bf12-55ed3ef49594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.329456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442f23b-8894-4585-bf12-55ed3ef49594 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.330731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442f23b-8894-4585-bf12-55ed3ef49594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:58.335012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442f23b-8894-4585-bf12-55ed3ef49594 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:58.340176 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9464ef64de249a6b1ce01865c5d7bb8', 'request_id': 'req-91dcb0af-1953-4456-a78c-1f1847dd9c77'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:58.372910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] The token cache is being invalidate because project b9464ef64de249a6b1ce01865c5d7bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:58.373614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:58.374964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:58.379653 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1113/2253] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:57 2022] DELETE /identity/v3/projects/b9464ef64de249a6b1ce01865c5d7bb8 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:58.380612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:58.386130 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:58.422340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcb0af-1953-4456-a78c-1f1847dd9c77 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:58.437000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:58.438071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:58.439141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.439981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] PATH_INFO: `/v3/projects/fa91486048854a8287c65aea8ba3e78b` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.442533 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa91486048854a8287c65aea8ba3e78b)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:58.452615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:58.507914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1141/2254] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:58 2022] POST /identity/v3/users => generated 292 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:58.512069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302e6b-9430-47d0-840b-dbdd6c7d074b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:58.512069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302e6b-9430-47d0-840b-dbdd6c7d074b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.512069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302e6b-9430-47d0-840b-dbdd6c7d074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.556828 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-10302e6b-9430-47d0-840b-dbdd6c7d074b None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:58.559198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-10302e6b-9430-47d0-840b-dbdd6c7d074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:58.572817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1142/2255] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:58.573981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10302e6b-9430-47d0-840b-dbdd6c7d074b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:58.578910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-10302e6b-9430-47d0-840b-dbdd6c7d074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:58.607270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10302e6b-9430-47d0-840b-dbdd6c7d074b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:58.622671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86373789-1dc7-40e0-9520-5b39a8fa8c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:58.624313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86373789-1dc7-40e0-9520-5b39a8fa8c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:58.624976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86373789-1dc7-40e0-9520-5b39a8fa8c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.626204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86373789-1dc7-40e0-9520-5b39a8fa8c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.628693 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86373789-1dc7-40e0-9520-5b39a8fa8c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:58.633785 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86373789-1dc7-40e0-9520-5b39a8fa8c1f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:58.665195 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa91486048854a8287c65aea8ba3e78b', 'request_id': 'req-ff1ed041-6387-4341-ae7e-1ffae0abca30'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:58.668128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa91486048854a8287c65aea8ba3e78b', 'request_id': 'req-ff1ed041-6387-4341-ae7e-1ffae0abca30'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:58.669439 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1143/2256] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:58.675010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15104bc-5e42-48ab-a99c-11c73f9e01f2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:58.675010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15104bc-5e42-48ab-a99c-11c73f9e01f2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.675010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15104bc-5e42-48ab-a99c-11c73f9e01f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.715320 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b15104bc-5e42-48ab-a99c-11c73f9e01f2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:58.720217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b15104bc-5e42-48ab-a99c-11c73f9e01f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:58.757477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:58.803695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa91486048854a8287c65aea8ba3e78b', 'request_id': 'req-ff1ed041-6387-4341-ae7e-1ffae0abca30'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:58.806213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1144/2257] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:58.807388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15104bc-5e42-48ab-a99c-11c73f9e01f2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:58.817018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] The token cache is being invalidate because project fa91486048854a8287c65aea8ba3e78b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:58.817362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:58.818328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:58.823799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1114/2258] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:58 2022] DELETE /identity/v3/projects/fa91486048854a8287c65aea8ba3e78b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:58.823799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:58.825177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:58.832066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15104bc-5e42-48ab-a99c-11c73f9e01f2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:58.842843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7a08b-0258-4249-9812-e6a8ca30bb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:58.843491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7a08b-0258-4249-9812-e6a8ca30bb87 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:58.844519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7a08b-0258-4249-9812-e6a8ca30bb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.844806 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7a08b-0258-4249-9812-e6a8ca30bb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.845554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7a08b-0258-4249-9812-e6a8ca30bb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:58.847275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7a08b-0258-4249-9812-e6a8ca30bb87 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:58.848479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ed041-6387-4341-ae7e-1ffae0abca30 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:58.856001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21277-e137-448a-9673-eae8e0acb7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:58.856936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21277-e137-448a-9673-eae8e0acb7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:58.857520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21277-e137-448a-9673-eae8e0acb7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.858018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21277-e137-448a-9673-eae8e0acb7d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.859018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa21277-e137-448a-9673-eae8e0acb7d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:58.859528 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa21277-e137-448a-9673-eae8e0acb7d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:58.861670 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1145/2259] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:58.862534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7a08b-0258-4249-9812-e6a8ca30bb87 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:58.864236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f2e7a08b-0258-4249-9812-e6a8ca30bb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:58.865507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa21277-e137-448a-9673-eae8e0acb7d6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:58.878583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7a08b-0258-4249-9812-e6a8ca30bb87 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:58.884103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1115/2260] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:58.884103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21277-e137-448a-9673-eae8e0acb7d6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:58.885560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5fa21277-e137-448a-9673-eae8e0acb7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:58.886082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:58.886799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:58.887083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.887359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] PATH_INFO: `/v3/users/2b3cbebff84c4e7a93864451fdfa915a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.888565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3cbebff84c4e7a93864451fdfa915a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:58.890577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:58.899990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21277-e137-448a-9673-eae8e0acb7d6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:58.907750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec3e0e-650d-4a3c-8ca3-f682f1ed53c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:58.909701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec3e0e-650d-4a3c-8ca3-f682f1ed53c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:58.910065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec3e0e-650d-4a3c-8ca3-f682f1ed53c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:58.910354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec3e0e-650d-4a3c-8ca3-f682f1ed53c3 admin admin] PATH_INFO: `/v3/projects/90e3e26fccc94e3d92f11fdfff6fd9c6/users/5daa9e99e7e64e04bafbc460abb65842/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:58.929065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec3e0e-650d-4a3c-8ca3-f682f1ed53c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e3e26fccc94e3d92f11fdfff6fd9c6, user_id=5daa9e99e7e64e04bafbc460abb65842, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:58.932651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec3e0e-650d-4a3c-8ca3-f682f1ed53c3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:59.089443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:59.094962 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1116/2261] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:58 2022] PUT /identity/v3/projects/90e3e26fccc94e3d92f11fdfff6fd9c6/users/5daa9e99e7e64e04bafbc460abb65842/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:59.097525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec3e0e-650d-4a3c-8ca3-f682f1ed53c3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:59.171085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec3e0e-650d-4a3c-8ca3-f682f1ed53c3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:59.178943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f007a6f-02ae-4d14-a180-ad0984287e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:59.179572 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007a6f-02ae-4d14-a180-ad0984287e63 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.180360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007a6f-02ae-4d14-a180-ad0984287e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.180711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007a6f-02ae-4d14-a180-ad0984287e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.181513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f007a6f-02ae-4d14-a180-ad0984287e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:59.183442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f007a6f-02ae-4d14-a180-ad0984287e63 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:59.204367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3cbebff84c4e7a93864451fdfa915a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:59.211944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3cbebff84c4e7a93864451fdfa915a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:59.253169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1117/2262] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:59 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:59.253169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b525a-fe57-427a-a63a-483b128215e9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.253169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b525a-fe57-427a-a63a-483b128215e9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.253169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b525a-fe57-427a-a63a-483b128215e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.260656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3cbebff84c4e7a93864451fdfa915a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:59.261318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3cbebff84c4e7a93864451fdfa915a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:59.261926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3cbebff84c4e7a93864451fdfa915a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:59.280914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1146/2263] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:58 2022] DELETE /identity/v3/users/2b3cbebff84c4e7a93864451fdfa915a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:59.283306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e79b525a-fe57-427a-a63a-483b128215e9 None None] MFA Rules not processed for user `5daa9e99e7e64e04bafbc460abb65842`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:59.284777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e79b525a-fe57-427a-a63a-483b128215e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:59.284888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:59.286256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:59.361536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2127e57-7122-4e6d-aaf0-36b342be671a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:59.365709 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1118/2264] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:59.366491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b525a-fe57-427a-a63a-483b128215e9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:59.367856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13931-9520-483b-b790-0fb96fff70f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:59.368513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13931-9520-483b-b790-0fb96fff70f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.368801 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13931-9520-483b-b790-0fb96fff70f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.369012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e79b525a-fe57-427a-a63a-483b128215e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:59.369113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13931-9520-483b-b790-0fb96fff70f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.370266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13931-9520-483b-b790-0fb96fff70f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:59.373706 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13931-9520-483b-b790-0fb96fff70f9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:59.384087 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b525a-fe57-427a-a63a-483b128215e9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:59.388827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409d013-2f92-4033-be92-fe4866d99112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:59.389510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409d013-2f92-4033-be92-fe4866d99112 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.393634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409d013-2f92-4033-be92-fe4866d99112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.393634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409d013-2f92-4033-be92-fe4866d99112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.393634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409d013-2f92-4033-be92-fe4866d99112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:59.393634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409d013-2f92-4033-be92-fe4866d99112 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:59.527072 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1119/2265] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:05:59 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:05:59.532370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409d013-2f92-4033-be92-fe4866d99112 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:59.546002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1147/2266] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:59 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:59.546914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13931-9520-483b-b790-0fb96fff70f9 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:59.560474 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13931-9520-483b-b790-0fb96fff70f9 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:59.618404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409d013-2f92-4033-be92-fe4866d99112 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:59.619387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49271418-a10d-4c13-b62e-a425e0c9ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:59.620754 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49271418-a10d-4c13-b62e-a425e0c9ed52 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.621287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49271418-a10d-4c13-b62e-a425e0c9ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.621741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49271418-a10d-4c13-b62e-a425e0c9ed52 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.622445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49271418-a10d-4c13-b62e-a425e0c9ed52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:59.624473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49271418-a10d-4c13-b62e-a425e0c9ed52 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:59.640608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbdaa9-b7e1-4656-beb9-e901c421a051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:59.642138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbdaa9-b7e1-4656-beb9-e901c421a051 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.642579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbdaa9-b7e1-4656-beb9-e901c421a051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.643402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbdaa9-b7e1-4656-beb9-e901c421a051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.644470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbdaa9-b7e1-4656-beb9-e901c421a051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:59.647078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbdaa9-b7e1-4656-beb9-e901c421a051 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:59.665059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1148/2267] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:05:59.666234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbdaa9-b7e1-4656-beb9-e901c421a051 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:59.679525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbdaa9-b7e1-4656-beb9-e901c421a051 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:59.686106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc105e-47e4-44b5-b91b-a22c59b88ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:59.686865 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc105e-47e4-44b5-b91b-a22c59b88ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.687329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc105e-47e4-44b5-b91b-a22c59b88ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.687560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc105e-47e4-44b5-b91b-a22c59b88ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.692494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc105e-47e4-44b5-b91b-a22c59b88ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:59.692494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc105e-47e4-44b5-b91b-a22c59b88ba1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:59.706498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1149/2268] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:59.707699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc105e-47e4-44b5-b91b-a22c59b88ba1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:59.718567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc105e-47e4-44b5-b91b-a22c59b88ba1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:59.723939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5819bd-d63f-476b-bfe8-82921962c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:59.724648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5819bd-d63f-476b-bfe8-82921962c308 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.725114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5819bd-d63f-476b-bfe8-82921962c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.725431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5819bd-d63f-476b-bfe8-82921962c308 admin admin] PATH_INFO: `/v3/projects/643ba639e7734c94865273faebf937f5/users/d1e28876386a4dbf9f2f6f648f863042/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.744591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5819bd-d63f-476b-bfe8-82921962c308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643ba639e7734c94865273faebf937f5, user_id=d1e28876386a4dbf9f2f6f648f863042, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:59.749079 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5819bd-d63f-476b-bfe8-82921962c308 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:59.779766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1120/2269] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:59 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:05:59.780718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49271418-a10d-4c13-b62e-a425e0c9ed52 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:59.793043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49271418-a10d-4c13-b62e-a425e0c9ed52 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:59.799715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afedbe-feb8-4649-b44e-7890d58f2565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:59.800357 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afedbe-feb8-4649-b44e-7890d58f2565 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.800641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afedbe-feb8-4649-b44e-7890d58f2565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.801311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afedbe-feb8-4649-b44e-7890d58f2565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.801665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afedbe-feb8-4649-b44e-7890d58f2565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:59.803316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afedbe-feb8-4649-b44e-7890d58f2565 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:59.814948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1121/2270] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:59.819239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afedbe-feb8-4649-b44e-7890d58f2565 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:59.829658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afedbe-feb8-4649-b44e-7890d58f2565 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:59.834482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89fb0-93aa-4f09-a3ad-54d67878097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:59.835329 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89fb0-93aa-4f09-a3ad-54d67878097c admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.835536 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89fb0-93aa-4f09-a3ad-54d67878097c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.835775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89fb0-93aa-4f09-a3ad-54d67878097c admin admin] PATH_INFO: `/v3/projects/c01695c4089f45909690b1525bf9308e/users/337bb13637a446a5abb87bbeec16fad0/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.859225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab89fb0-93aa-4f09-a3ad-54d67878097c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01695c4089f45909690b1525bf9308e, user_id=337bb13637a446a5abb87bbeec16fad0, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:59.859225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab89fb0-93aa-4f09-a3ad-54d67878097c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:59.866568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1150/2271] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:59 2022] PUT /identity/v3/projects/643ba639e7734c94865273faebf937f5/users/d1e28876386a4dbf9f2f6f648f863042/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:59.878168 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa730b8a-56a1-491e-bf63-c991eb3086c1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:59.878456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa730b8a-56a1-491e-bf63-c991eb3086c1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:59.878734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa730b8a-56a1-491e-bf63-c991eb3086c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:59.912795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-fa730b8a-56a1-491e-bf63-c991eb3086c1 None None] MFA Rules not processed for user `d1e28876386a4dbf9f2f6f648f863042`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:59.915297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fa730b8a-56a1-491e-bf63-c991eb3086c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:59.949275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1122/2272] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:05:59 2022] PUT /identity/v3/projects/c01695c4089f45909690b1525bf9308e/users/337bb13637a446a5abb87bbeec16fad0/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:05:59.953107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89fb0-93aa-4f09-a3ad-54d67878097c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:00.035224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1151/2273] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:05:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:00.035224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa730b8a-56a1-491e-bf63-c991eb3086c1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:00.036017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fa730b8a-56a1-491e-bf63-c991eb3086c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:00.059569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89fb0-93aa-4f09-a3ad-54d67878097c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:00.068096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d18440-187c-4872-969a-e2e0aa571953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:00.068965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18440-187c-4872-969a-e2e0aa571953 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.069481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18440-187c-4872-969a-e2e0aa571953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.069907 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18440-187c-4872-969a-e2e0aa571953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.070820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d18440-187c-4872-969a-e2e0aa571953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:00.072626 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d18440-187c-4872-969a-e2e0aa571953 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:00.089311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1123/2274] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:06:00.089311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d18440-187c-4872-969a-e2e0aa571953 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:00.093088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-57d18440-187c-4872-969a-e2e0aa571953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:00.168804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:00.175196 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d18440-187c-4872-969a-e2e0aa571953 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:00.177067 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa730b8a-56a1-491e-bf63-c991eb3086c1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:00.180489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e408ba7-baa9-4dbc-9541-eb2a4682f6e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:00.181517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e408ba7-baa9-4dbc-9541-eb2a4682f6e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.181872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e408ba7-baa9-4dbc-9541-eb2a4682f6e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.182251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e408ba7-baa9-4dbc-9541-eb2a4682f6e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.189479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:00.190292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.190656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.191002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] PATH_INFO: `/v3/projects/67124e3b43aa4681a115593cb0cb84c4` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.194591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67124e3b43aa4681a115593cb0cb84c4)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:00.199046 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:00.263576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e408ba7-baa9-4dbc-9541-eb2a4682f6e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:00.264899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e408ba7-baa9-4dbc-9541-eb2a4682f6e0 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:00.282408 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1124/2275] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:00.283549 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e408ba7-baa9-4dbc-9541-eb2a4682f6e0 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:00.306814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e408ba7-baa9-4dbc-9541-eb2a4682f6e0 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:00.321043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67124e3b43aa4681a115593cb0cb84c4', 'request_id': 'req-7343018b-7201-46b5-9a42-bd6a4431d7e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:00.328117 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67124e3b43aa4681a115593cb0cb84c4', 'request_id': 'req-7343018b-7201-46b5-9a42-bd6a4431d7e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:00.334598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67124e3b43aa4681a115593cb0cb84c4', 'request_id': 'req-7343018b-7201-46b5-9a42-bd6a4431d7e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:00.380090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d1785-d14f-43c9-88ff-e98247266b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:00.380779 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d1785-d14f-43c9-88ff-e98247266b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.381089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d1785-d14f-43c9-88ff-e98247266b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.381405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d1785-d14f-43c9-88ff-e98247266b2c admin admin] PATH_INFO: `/v3/projects/c01695c4089f45909690b1525bf9308e/users/337bb13637a446a5abb87bbeec16fad0/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.383932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d1785-d14f-43c9-88ff-e98247266b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01695c4089f45909690b1525bf9308e, user_id=337bb13637a446a5abb87bbeec16fad0, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:00.386857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d1785-d14f-43c9-88ff-e98247266b2c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:00.403301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1125/2276] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:00 2022] PUT /identity/v3/projects/c01695c4089f45909690b1525bf9308e/users/337bb13637a446a5abb87bbeec16fad0/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:00.415544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5137b5-f3dc-4128-9a23-361c1ef388a5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.415829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5137b5-f3dc-4128-9a23-361c1ef388a5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.416213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5137b5-f3dc-4128-9a23-361c1ef388a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.422927 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] The token cache is being invalidate because project 67124e3b43aa4681a115593cb0cb84c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:00.423223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:00.424046 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7343018b-7201-46b5-9a42-bd6a4431d7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:00.429407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1152/2277] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:00 2022] DELETE /identity/v3/projects/67124e3b43aa4681a115593cb0cb84c4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:00.433761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcebd2f-f6f0-40eb-9dbf-ae8e7482be9f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.434271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcebd2f-f6f0-40eb-9dbf-ae8e7482be9f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.434939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcebd2f-f6f0-40eb-9dbf-ae8e7482be9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.452115 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7d5137b5-f3dc-4128-9a23-361c1ef388a5 None None] MFA Rules not processed for user `337bb13637a446a5abb87bbeec16fad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:00.453691 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7d5137b5-f3dc-4128-9a23-361c1ef388a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:00.458105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-adcebd2f-f6f0-40eb-9dbf-ae8e7482be9f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:00.459359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-adcebd2f-f6f0-40eb-9dbf-ae8e7482be9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:00.526826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1126/2278] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:00.532832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1153/2279] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:00.542239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef99b-a7aa-4cd9-8ffc-972251fd77ea None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.542544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef99b-a7aa-4cd9-8ffc-972251fd77ea None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.542820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef99b-a7aa-4cd9-8ffc-972251fd77ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.562197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7f2ef99b-a7aa-4cd9-8ffc-972251fd77ea None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:00.563392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7f2ef99b-a7aa-4cd9-8ffc-972251fd77ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:00.571494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1127/2280] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:00.574433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:00.575931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcebd2f-f6f0-40eb-9dbf-ae8e7482be9f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:00.585530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcebd2f-f6f0-40eb-9dbf-ae8e7482be9f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:00.591412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab482a-2e1f-4b4b-84b6-9a06f5aa7472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:00.592037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab482a-2e1f-4b4b-84b6-9a06f5aa7472 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.592319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab482a-2e1f-4b4b-84b6-9a06f5aa7472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.592595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab482a-2e1f-4b4b-84b6-9a06f5aa7472 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.593331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab482a-2e1f-4b4b-84b6-9a06f5aa7472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:06:00.593672 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab482a-2e1f-4b4b-84b6-9a06f5aa7472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:00.595496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab482a-2e1f-4b4b-84b6-9a06f5aa7472 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:00.608541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1154/2281] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:06:00.613204 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef99b-a7aa-4cd9-8ffc-972251fd77ea None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:00.622686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef99b-a7aa-4cd9-8ffc-972251fd77ea None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:00.627537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3be2-c371-4157-b737-74084cb8541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:00.628117 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3be2-c371-4157-b737-74084cb8541a admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.628397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3be2-c371-4157-b737-74084cb8541a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.628671 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3be2-c371-4157-b737-74084cb8541a admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.629438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e3be2-c371-4157-b737-74084cb8541a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:00.631355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e3be2-c371-4157-b737-74084cb8541a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:00.753322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1128/2282] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:06:00 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:00.757583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab482a-2e1f-4b4b-84b6-9a06f5aa7472 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:00.767754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab482a-2e1f-4b4b-84b6-9a06f5aa7472 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:00.825444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db402411-b86c-464f-9408-26eb65f5dae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:00.826063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db402411-b86c-464f-9408-26eb65f5dae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.826344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db402411-b86c-464f-9408-26eb65f5dae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.826618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db402411-b86c-464f-9408-26eb65f5dae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.827292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db402411-b86c-464f-9408-26eb65f5dae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:00.829247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db402411-b86c-464f-9408-26eb65f5dae0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:00.934487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1155/2283] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:06:00 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:00.938643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3be2-c371-4157-b737-74084cb8541a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:00.950911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3be2-c371-4157-b737-74084cb8541a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:00.956659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24059649-7796-412d-9794-c79d635edc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:00.957362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24059649-7796-412d-9794-c79d635edc04 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:00.957648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24059649-7796-412d-9794-c79d635edc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:00.957926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24059649-7796-412d-9794-c79d635edc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:00.958696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24059649-7796-412d-9794-c79d635edc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:00.960582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24059649-7796-412d-9794-c79d635edc04 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:00.974757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1129/2284] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:06:00.978815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db402411-b86c-464f-9408-26eb65f5dae0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:00.992357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db402411-b86c-464f-9408-26eb65f5dae0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:01.021149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bac184-28b8-4686-a4ec-02be13368d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:01.021149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bac184-28b8-4686-a4ec-02be13368d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:01.021149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bac184-28b8-4686-a4ec-02be13368d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:01.021149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bac184-28b8-4686-a4ec-02be13368d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:01.021705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bac184-28b8-4686-a4ec-02be13368d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:01.021705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bac184-28b8-4686-a4ec-02be13368d3a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:01.033207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24059649-7796-412d-9794-c79d635edc04 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:01.034124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1156/2285] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:06:01.035637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-24059649-7796-412d-9794-c79d635edc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:01.044085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bac184-28b8-4686-a4ec-02be13368d3a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:01.059026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bac184-28b8-4686-a4ec-02be13368d3a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:01.064944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89f443-df48-456e-9837-deb945f88abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:01.065975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89f443-df48-456e-9837-deb945f88abe admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:01.074498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89f443-df48-456e-9837-deb945f88abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:01.074498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89f443-df48-456e-9837-deb945f88abe admin admin] PATH_INFO: `/v3/projects/1f73eac1974f44daa81e1db18f443392/users/6b3943e048c74945af4a3f9c8b4af158/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:01.086796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89f443-df48-456e-9837-deb945f88abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f73eac1974f44daa81e1db18f443392, user_id=6b3943e048c74945af4a3f9c8b4af158, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:01.090016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89f443-df48-456e-9837-deb945f88abe admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:01.105166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24059649-7796-412d-9794-c79d635edc04 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:01.109523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff248dc0-3677-4f57-b903-40162747de2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:01.110306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff248dc0-3677-4f57-b903-40162747de2d service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:01.110543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff248dc0-3677-4f57-b903-40162747de2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:01.110823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff248dc0-3677-4f57-b903-40162747de2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:01.113161 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ff248dc0-3677-4f57-b903-40162747de2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:01.200532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1157/2286] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:01 2022] PUT /identity/v3/projects/1f73eac1974f44daa81e1db18f443392/users/6b3943e048c74945af4a3f9c8b4af158/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:06:01.203421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff248dc0-3677-4f57-b903-40162747de2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:01.204883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff248dc0-3677-4f57-b903-40162747de2d service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:01.210771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e02d-e754-42f0-8443-6a9e3d63f671 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:01.211644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e02d-e754-42f0-8443-6a9e3d63f671 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:01.212146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e02d-e754-42f0-8443-6a9e3d63f671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:01.218566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1130/2287] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:06:01.260391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2d02e02d-e754-42f0-8443-6a9e3d63f671 None None] MFA Rules not processed for user `6b3943e048c74945af4a3f9c8b4af158`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:01.261738 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2d02e02d-e754-42f0-8443-6a9e3d63f671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:01.361286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1158/2288] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:01.365899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff248dc0-3677-4f57-b903-40162747de2d service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:01.377229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff248dc0-3677-4f57-b903-40162747de2d service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:01.439400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746e971-ee17-42d8-9c6f-d7db43553036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:01.439400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746e971-ee17-42d8-9c6f-d7db43553036 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:01.439400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746e971-ee17-42d8-9c6f-d7db43553036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:01.439400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746e971-ee17-42d8-9c6f-d7db43553036 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:01.440247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746e971-ee17-42d8-9c6f-d7db43553036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:01.441867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746e971-ee17-42d8-9c6f-d7db43553036 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:01.556443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1131/2289] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:06:01 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:01.557926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e02d-e754-42f0-8443-6a9e3d63f671 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:01.569239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e02d-e754-42f0-8443-6a9e3d63f671 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:01.647697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ac9df-1ebe-4d73-a405-dd8bc38f7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:01.647697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac9df-1ebe-4d73-a405-dd8bc38f7e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:01.647697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac9df-1ebe-4d73-a405-dd8bc38f7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:01.647697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac9df-1ebe-4d73-a405-dd8bc38f7e3a admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:01.649901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ac9df-1ebe-4d73-a405-dd8bc38f7e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:01.649901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ac9df-1ebe-4d73-a405-dd8bc38f7e3a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:01.735145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1159/2290] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:06:01 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:01.739335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746e971-ee17-42d8-9c6f-d7db43553036 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:01.750632 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746e971-ee17-42d8-9c6f-d7db43553036 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:01.755226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b296a-a55f-4db7-9c65-6250c2626ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:01.755781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b296a-a55f-4db7-9c65-6250c2626ece admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:01.756061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b296a-a55f-4db7-9c65-6250c2626ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:01.756339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b296a-a55f-4db7-9c65-6250c2626ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:01.757033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b296a-a55f-4db7-9c65-6250c2626ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:01.759522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b296a-a55f-4db7-9c65-6250c2626ece admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:01.770385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1132/2291] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:06:01.775384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ac9df-1ebe-4d73-a405-dd8bc38f7e3a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:01.785782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ac9df-1ebe-4d73-a405-dd8bc38f7e3a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:01.790721 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7085f7-7b6c-4be0-94f6-55b6ca3b0a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:01.793851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7085f7-7b6c-4be0-94f6-55b6ca3b0a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:01.793851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7085f7-7b6c-4be0-94f6-55b6ca3b0a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:01.793851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7085f7-7b6c-4be0-94f6-55b6ca3b0a82 admin admin] PATH_INFO: `/v3/projects/5db9c0aabd354c9a92b4eb5eb15de782/users/a0a0463d39024ae5a6c22d4e14baa014/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:01.807892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7085f7-7b6c-4be0-94f6-55b6ca3b0a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db9c0aabd354c9a92b4eb5eb15de782, user_id=a0a0463d39024ae5a6c22d4e14baa014, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:01.811133 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7085f7-7b6c-4be0-94f6-55b6ca3b0a82 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:01.838210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:01.940957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1160/2292] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:01 2022] PUT /identity/v3/projects/5db9c0aabd354c9a92b4eb5eb15de782/users/a0a0463d39024ae5a6c22d4e14baa014/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:01.943760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b296a-a55f-4db7-9c65-6250c2626ece admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:01.954942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b296a-a55f-4db7-9c65-6250c2626ece admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:02.020656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:02.021388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799f5dc-a44c-44a5-88de-10b80d42bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:02.022023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799f5dc-a44c-44a5-88de-10b80d42bf7d admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:02.022307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799f5dc-a44c-44a5-88de-10b80d42bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:02.022586 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799f5dc-a44c-44a5-88de-10b80d42bf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:02.023923 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799f5dc-a44c-44a5-88de-10b80d42bf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:02.025777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799f5dc-a44c-44a5-88de-10b80d42bf7d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:02.036881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1133/2293] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:06:02.041646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7085f7-7b6c-4be0-94f6-55b6ca3b0a82 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:02.052273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7085f7-7b6c-4be0-94f6-55b6ca3b0a82 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:02.057267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf847f36-9031-4ae8-852c-6cbb86d9a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:02.057947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf847f36-9031-4ae8-852c-6cbb86d9a352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:02.058217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf847f36-9031-4ae8-852c-6cbb86d9a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:02.058506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf847f36-9031-4ae8-852c-6cbb86d9a352 admin admin] PATH_INFO: `/v3/projects/5db9c0aabd354c9a92b4eb5eb15de782/users/a0a0463d39024ae5a6c22d4e14baa014/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:02.060457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf847f36-9031-4ae8-852c-6cbb86d9a352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db9c0aabd354c9a92b4eb5eb15de782, user_id=a0a0463d39024ae5a6c22d4e14baa014, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:02.064159 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf847f36-9031-4ae8-852c-6cbb86d9a352 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:02.075163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1161/2294] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:02 2022] PUT /identity/v3/projects/5db9c0aabd354c9a92b4eb5eb15de782/users/a0a0463d39024ae5a6c22d4e14baa014/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:02.087793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b28535-6213-4d62-9fd5-029c4917a02c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:02.088088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b28535-6213-4d62-9fd5-029c4917a02c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:02.088365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b28535-6213-4d62-9fd5-029c4917a02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:02.117961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-63b28535-6213-4d62-9fd5-029c4917a02c None None] MFA Rules not processed for user `a0a0463d39024ae5a6c22d4e14baa014`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:02.119183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-63b28535-6213-4d62-9fd5-029c4917a02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:02.204058 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1134/2295] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:02.215404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf847f36-9031-4ae8-852c-6cbb86d9a352 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:02.217219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bf847f36-9031-4ae8-852c-6cbb86d9a352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:02.297824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf847f36-9031-4ae8-852c-6cbb86d9a352 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:02.302373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0d35-40be-43e3-ab62-151024ef8b2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:02.303091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0d35-40be-43e3-ab62-151024ef8b2d service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:02.303380 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0d35-40be-43e3-ab62-151024ef8b2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:02.303702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0d35-40be-43e3-ab62-151024ef8b2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:02.390925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca0d35-40be-43e3-ab62-151024ef8b2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:02.392515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca0d35-40be-43e3-ab62-151024ef8b2d service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:02.404887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1162/2296] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:02.442998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:02.500065 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:03.396458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b28535-6213-4d62-9fd5-029c4917a02c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:03.407114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b28535-6213-4d62-9fd5-029c4917a02c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:03.410925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076d3c7-8930-4419-ac12-a3e80c734bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:03.411537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d3c7-8930-4419-ac12-a3e80c734bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:03.411817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d3c7-8930-4419-ac12-a3e80c734bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:03.412089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d3c7-8930-4419-ac12-a3e80c734bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:03.415182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1076d3c7-8930-4419-ac12-a3e80c734bd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:03.479857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076d3c7-8930-4419-ac12-a3e80c734bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:03.481409 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076d3c7-8930-4419-ac12-a3e80c734bd2 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:03.490855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1135/2297] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:03.613948 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:03.642438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:04.117818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:04.180681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:04.448368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:04.613831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:04.665885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:06.681294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0d35-40be-43e3-ab62-151024ef8b2d service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:06.692952 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0d35-40be-43e3-ab62-151024ef8b2d service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:06.697550 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa1562-8e82-4474-9491-ed9d1385f839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:06.698505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa1562-8e82-4474-9491-ed9d1385f839 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:06.698505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa1562-8e82-4474-9491-ed9d1385f839 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:06.698894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa1562-8e82-4474-9491-ed9d1385f839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:06.703710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:06.789263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa1562-8e82-4474-9491-ed9d1385f839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:06.791429 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa1562-8e82-4474-9491-ed9d1385f839 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:06.802393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1163/2298] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:12.656716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076d3c7-8930-4419-ac12-a3e80c734bd2 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:12.667119 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076d3c7-8930-4419-ac12-a3e80c734bd2 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:12.671392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9d68-a58b-4a69-b083-e814bf9d5882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:12.672219 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9d68-a58b-4a69-b083-e814bf9d5882 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:12.672600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9d68-a58b-4a69-b083-e814bf9d5882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:12.672935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9d68-a58b-4a69-b083-e814bf9d5882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:12.684804 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9d68-a58b-4a69-b083-e814bf9d5882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:12.686272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9d68-a58b-4a69-b083-e814bf9d5882 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:12.698797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1136/2299] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:14.482220 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa1562-8e82-4474-9491-ed9d1385f839 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:14.485842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-56fa1562-8e82-4474-9491-ed9d1385f839 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:14.563538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa1562-8e82-4474-9491-ed9d1385f839 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:14.569306 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:14.569987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:14.570263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:14.570540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] PATH_INFO: `/v3/users/ba2471cbb40b4345bfcf105334982df7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:14.571876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2471cbb40b4345bfcf105334982df7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:14.574058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:14.827299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2471cbb40b4345bfcf105334982df7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:14.838521 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2471cbb40b4345bfcf105334982df7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:14.899225 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2471cbb40b4345bfcf105334982df7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:14.899946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2471cbb40b4345bfcf105334982df7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:14.900579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2471cbb40b4345bfcf105334982df7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:14.920626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1164/2300] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:06:14 2022] DELETE /identity/v3/users/ba2471cbb40b4345bfcf105334982df7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:14.926564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb8cc-5885-4337-b593-dd3c1c6b57f5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:14.927068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb8cc-5885-4337-b593-dd3c1c6b57f5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:14.927418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb8cc-5885-4337-b593-dd3c1c6b57f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:14.948274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-163cb8cc-5885-4337-b593-dd3c1c6b57f5 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:14.950992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-163cb8cc-5885-4337-b593-dd3c1c6b57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:15.020349 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1137/2301] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:15.030877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:15.032415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:15.057759 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:15.106736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf212b-0a1b-4279-a833-a2f79fbbacb5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:15.111041 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea35729-5229-4012-ad69-c106a7fe82d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:15.111880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea35729-5229-4012-ad69-c106a7fe82d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:15.112634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea35729-5229-4012-ad69-c106a7fe82d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:15.112918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea35729-5229-4012-ad69-c106a7fe82d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:15.124384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea35729-5229-4012-ad69-c106a7fe82d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:15.125880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea35729-5229-4012-ad69-c106a7fe82d9 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:15.138157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1165/2302] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:15.669393 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb8cc-5885-4337-b593-dd3c1c6b57f5 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:15.671079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-163cb8cc-5885-4337-b593-dd3c1c6b57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:15.690556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb8cc-5885-4337-b593-dd3c1c6b57f5 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:15.704362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:15.704900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:15.705504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:15.705504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] PATH_INFO: `/v3/projects/95c9f01eff194f05a2c62da2da7c1bb9` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:15.707835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c9f01eff194f05a2c62da2da7c1bb9)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:15.709410 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:15.881413 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c9f01eff194f05a2c62da2da7c1bb9', 'request_id': 'req-d9af60a3-5764-4d34-a318-ae08d542f080'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:15.889732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c9f01eff194f05a2c62da2da7c1bb9', 'request_id': 'req-d9af60a3-5764-4d34-a318-ae08d542f080'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:15.974614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c9f01eff194f05a2c62da2da7c1bb9', 'request_id': 'req-d9af60a3-5764-4d34-a318-ae08d542f080'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:15.993084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] The token cache is being invalidate because project 95c9f01eff194f05a2c62da2da7c1bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:15.994111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:15.994784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9af60a3-5764-4d34-a318-ae08d542f080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:15.997388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1138/2303] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:15 2022] DELETE /identity/v3/projects/95c9f01eff194f05a2c62da2da7c1bb9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:06:16.001370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea35729-5229-4012-ad69-c106a7fe82d9 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:16.025687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea35729-5229-4012-ad69-c106a7fe82d9 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:16.111974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:16.112633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:16.112918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:16.113222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] PATH_INFO: `/v3/users/5daa9e99e7e64e04bafbc460abb65842` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:16.114408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5daa9e99e7e64e04bafbc460abb65842)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:16.116364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:16.360605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5daa9e99e7e64e04bafbc460abb65842'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:16.367564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5daa9e99e7e64e04bafbc460abb65842'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:16.471272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5daa9e99e7e64e04bafbc460abb65842'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:16.471922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5daa9e99e7e64e04bafbc460abb65842'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:16.472524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5daa9e99e7e64e04bafbc460abb65842'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:16.491105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1166/2304] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:06:16 2022] DELETE /identity/v3/users/5daa9e99e7e64e04bafbc460abb65842 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:16.542455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726c257-cf70-41ea-ada1-b10b69485ba6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:16.542741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726c257-cf70-41ea-ada1-b10b69485ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:16.543016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726c257-cf70-41ea-ada1-b10b69485ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:16.563768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0726c257-cf70-41ea-ada1-b10b69485ba6 None None] MFA Rules not processed for user `61d3b5a3082a4c74a2a08007581388c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:16.564981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0726c257-cf70-41ea-ada1-b10b69485ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:16.621997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1139/2305] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:17.065424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:17.066998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:17.138748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:17.163879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9918d-7fdc-45cb-a77f-32c251b9e9dc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:17.177304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:17.178000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:17.178578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:17.178930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] PATH_INFO: `/v3/projects/90e3e26fccc94e3d92f11fdfff6fd9c6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:17.180929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e3e26fccc94e3d92f11fdfff6fd9c6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:17.183109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:17.281273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e3e26fccc94e3d92f11fdfff6fd9c6', 'request_id': 'req-1dd1be26-14f9-461f-a135-55e2afafac97'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:17.288323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e3e26fccc94e3d92f11fdfff6fd9c6', 'request_id': 'req-1dd1be26-14f9-461f-a135-55e2afafac97'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:17.294501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e3e26fccc94e3d92f11fdfff6fd9c6', 'request_id': 'req-1dd1be26-14f9-461f-a135-55e2afafac97'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:17.379589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] The token cache is being invalidate because project 90e3e26fccc94e3d92f11fdfff6fd9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:17.379883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:17.380561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:17.382142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1167/2306] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:17 2022] DELETE /identity/v3/projects/90e3e26fccc94e3d92f11fdfff6fd9c6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:17.387059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726c257-cf70-41ea-ada1-b10b69485ba6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:17.394004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:17.398927 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726c257-cf70-41ea-ada1-b10b69485ba6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:17.458258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:17.463098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:17.463098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:17.463098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] PATH_INFO: `/v3/users/337bb13637a446a5abb87bbeec16fad0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:17.463098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337bb13637a446a5abb87bbeec16fad0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:17.463098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:17.745623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337bb13637a446a5abb87bbeec16fad0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:17.746327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337bb13637a446a5abb87bbeec16fad0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:17.855307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337bb13637a446a5abb87bbeec16fad0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:17.873344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337bb13637a446a5abb87bbeec16fad0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:17.882574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f582d810-d821-45fe-bdd7-9ec2d603b134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337bb13637a446a5abb87bbeec16fad0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:17.891751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1140/2307] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:06:17 2022] DELETE /identity/v3/users/337bb13637a446a5abb87bbeec16fad0 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:18.390732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:18.392268 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:18.407106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1be26-14f9-461f-a135-55e2afafac97 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:18.470694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:18.471435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:18.471712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:18.471990 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] PATH_INFO: `/v3/projects/c01695c4089f45909690b1525bf9308e` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:18.473264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01695c4089f45909690b1525bf9308e)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:18.475368 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:18.683532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01695c4089f45909690b1525bf9308e', 'request_id': 'req-78c5caaa-4476-4d48-b41d-035e01790b79'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:18.690449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01695c4089f45909690b1525bf9308e', 'request_id': 'req-78c5caaa-4476-4d48-b41d-035e01790b79'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:18.696723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01695c4089f45909690b1525bf9308e', 'request_id': 'req-78c5caaa-4476-4d48-b41d-035e01790b79'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:18.780466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] The token cache is being invalidate because project c01695c4089f45909690b1525bf9308e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:18.780889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:18.781647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78c5caaa-4476-4d48-b41d-035e01790b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:18.783267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1168/2308] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:18 2022] DELETE /identity/v3/projects/c01695c4089f45909690b1525bf9308e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:18.788648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de9f6-8453-4ebb-95e6-37e83282e299 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:18.789189 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de9f6-8453-4ebb-95e6-37e83282e299 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:18.789357 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de9f6-8453-4ebb-95e6-37e83282e299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:18.813301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c06de9f6-8453-4ebb-95e6-37e83282e299 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:18.814534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c06de9f6-8453-4ebb-95e6-37e83282e299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:18.892190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1141/2309] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:18.908300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2f44c-6bfb-4899-8fd5-4e51676058db None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:18.908500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2f44c-6bfb-4899-8fd5-4e51676058db None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:18.908886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2f44c-6bfb-4899-8fd5-4e51676058db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:18.917855 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:18.932140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e7c2f44c-6bfb-4899-8fd5-4e51676058db None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:18.933428 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e7c2f44c-6bfb-4899-8fd5-4e51676058db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:18.951537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1169/2310] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:18.952193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06de9f6-8453-4ebb-95e6-37e83282e299 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:18.962274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06de9f6-8453-4ebb-95e6-37e83282e299 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:18.967459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e70ca-78cc-421b-9466-cfdef0e43ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:18.967620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e70ca-78cc-421b-9466-cfdef0e43ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:18.967903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e70ca-78cc-421b-9466-cfdef0e43ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:18.968177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e70ca-78cc-421b-9466-cfdef0e43ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:18.968902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e70ca-78cc-421b-9466-cfdef0e43ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:06:18.969234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e70ca-78cc-421b-9466-cfdef0e43ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:18.970843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e70ca-78cc-421b-9466-cfdef0e43ec9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:18.983265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1142/2311] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:06:19.033931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2f44c-6bfb-4899-8fd5-4e51676058db None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:19.044161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2f44c-6bfb-4899-8fd5-4e51676058db None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:19.049217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb055b-5ab3-4839-b55a-f28020422bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:19.049848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb055b-5ab3-4839-b55a-f28020422bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:19.064816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb055b-5ab3-4839-b55a-f28020422bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:19.064816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb055b-5ab3-4839-b55a-f28020422bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:19.064816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb055b-5ab3-4839-b55a-f28020422bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:19.064816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb055b-5ab3-4839-b55a-f28020422bb1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:19.198751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1170/2312] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:06:19 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:19.203581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e70ca-78cc-421b-9466-cfdef0e43ec9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:19.215153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e70ca-78cc-421b-9466-cfdef0e43ec9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:19.223572 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:19.269491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb055b-5ab3-4839-b55a-f28020422bb1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:19.271247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-94cb055b-5ab3-4839-b55a-f28020422bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:19.274608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5168c4-170d-45f8-bea8-99db64d951e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:19.275404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5168c4-170d-45f8-bea8-99db64d951e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:19.275685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5168c4-170d-45f8-bea8-99db64d951e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:19.276222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5168c4-170d-45f8-bea8-99db64d951e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:19.276893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5168c4-170d-45f8-bea8-99db64d951e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:19.278872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5168c4-170d-45f8-bea8-99db64d951e3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:19.284809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb055b-5ab3-4839-b55a-f28020422bb1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:19.291797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:19.292510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:19.292789 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:19.293061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] PATH_INFO: `/v3/users/6b3943e048c74945af4a3f9c8b4af158` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:19.294330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3943e048c74945af4a3f9c8b4af158)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:19.296414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:19.362875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1143/2313] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:06:19 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:06:19.366899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5168c4-170d-45f8-bea8-99db64d951e3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:19.376664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5168c4-170d-45f8-bea8-99db64d951e3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:19.381489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ee817-c68d-4658-8d76-81164a9e7a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:19.382133 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ee817-c68d-4658-8d76-81164a9e7a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:19.382416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ee817-c68d-4658-8d76-81164a9e7a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:19.382690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ee817-c68d-4658-8d76-81164a9e7a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:19.383468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ee817-c68d-4658-8d76-81164a9e7a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:19.385096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ee817-c68d-4658-8d76-81164a9e7a2c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:19.399685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1144/2314] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:06:19.401023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ee817-c68d-4658-8d76-81164a9e7a2c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:19.410850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ee817-c68d-4658-8d76-81164a9e7a2c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:19.416218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45f319-0777-4e75-a9ce-cf2eee34c30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:19.416829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f319-0777-4e75-a9ce-cf2eee34c30a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:19.417107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f319-0777-4e75-a9ce-cf2eee34c30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:19.417414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f319-0777-4e75-a9ce-cf2eee34c30a admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:19.422612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45f319-0777-4e75-a9ce-cf2eee34c30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:19.422612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45f319-0777-4e75-a9ce-cf2eee34c30a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:19.429749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1145/2315] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:06:19.434145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45f319-0777-4e75-a9ce-cf2eee34c30a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:19.443610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45f319-0777-4e75-a9ce-cf2eee34c30a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:19.449320 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac706a3-aa8b-4063-a04b-22e69059895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:19.449912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac706a3-aa8b-4063-a04b-22e69059895d admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:19.450214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac706a3-aa8b-4063-a04b-22e69059895d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:19.450474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac706a3-aa8b-4063-a04b-22e69059895d admin admin] PATH_INFO: `/v3/projects/78f2a5cc4b7d4699ad5b00d3f3a9830e/users/ec45d64732fe4aac9fe6b9d6cd04a6f4/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:19.465899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac706a3-aa8b-4063-a04b-22e69059895d admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f2a5cc4b7d4699ad5b00d3f3a9830e, user_id=ec45d64732fe4aac9fe6b9d6cd04a6f4, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:19.468573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac706a3-aa8b-4063-a04b-22e69059895d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:19.621232 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3943e048c74945af4a3f9c8b4af158'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:19.627921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3943e048c74945af4a3f9c8b4af158'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:19.643177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1146/2316] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:19 2022] PUT /identity/v3/projects/78f2a5cc4b7d4699ad5b00d3f3a9830e/users/ec45d64732fe4aac9fe6b9d6cd04a6f4/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:06:19.648282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1181-2c66-436c-8e49-3c920c7a4572 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:19.648590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1181-2c66-436c-8e49-3c920c7a4572 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:19.648873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1181-2c66-436c-8e49-3c920c7a4572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:19.668610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bd3a1181-2c66-436c-8e49-3c920c7a4572 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:19.669908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bd3a1181-2c66-436c-8e49-3c920c7a4572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:19.730492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1147/2317] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:19.740022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a1181-2c66-436c-8e49-3c920c7a4572 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:19.741523 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bd3a1181-2c66-436c-8e49-3c920c7a4572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:19.768206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3943e048c74945af4a3f9c8b4af158'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:19.769146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3943e048c74945af4a3f9c8b4af158'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:19.769816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-22a64b83-645b-4dee-9ec6-baa85933e1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3943e048c74945af4a3f9c8b4af158'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:19.796842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1171/2318] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:06:19 2022] DELETE /identity/v3/users/6b3943e048c74945af4a3f9c8b4af158 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:06:19.800883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a1181-2c66-436c-8e49-3c920c7a4572 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:19.801448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d4f8-1aa2-4356-88c4-b06f3071cc82 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:19.802201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d4f8-1aa2-4356-88c4-b06f3071cc82 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:19.802902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d4f8-1aa2-4356-88c4-b06f3071cc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:19.823613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4b45d4f8-1aa2-4356-88c4-b06f3071cc82 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:19.824832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4b45d4f8-1aa2-4356-88c4-b06f3071cc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:19.860490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5283a-2e71-45ea-80a7-adb391e0d733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:19.862817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5283a-2e71-45ea-80a7-adb391e0d733 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:19.862817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5283a-2e71-45ea-80a7-adb391e0d733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:19.862817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5283a-2e71-45ea-80a7-adb391e0d733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:19.874757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6ce5283a-2e71-45ea-80a7-adb391e0d733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:19.901087 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1172/2319] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:19.911207 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d4f8-1aa2-4356-88c4-b06f3071cc82 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:19.912734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4b45d4f8-1aa2-4356-88c4-b06f3071cc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:19.925312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d4f8-1aa2-4356-88c4-b06f3071cc82 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:19.929552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97542a-b5d9-4cbc-84e0-fa1b9c9453e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:19.930176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97542a-b5d9-4cbc-84e0-fa1b9c9453e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:19.930458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97542a-b5d9-4cbc-84e0-fa1b9c9453e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:19.930759 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97542a-b5d9-4cbc-84e0-fa1b9c9453e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:19.939446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:19.941776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97542a-b5d9-4cbc-84e0-fa1b9c9453e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:19.943227 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97542a-b5d9-4cbc-84e0-fa1b9c9453e5 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:19.952361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5283a-2e71-45ea-80a7-adb391e0d733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:19.953868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5283a-2e71-45ea-80a7-adb391e0d733 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:19.954670 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1173/2320] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:06:19.966165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1148/2321] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:06:20.533188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97542a-b5d9-4cbc-84e0-fa1b9c9453e5 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:20.535125 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9f97542a-b5d9-4cbc-84e0-fa1b9c9453e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:20.549329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97542a-b5d9-4cbc-84e0-fa1b9c9453e5 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:20.554441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:20.555089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:20.555321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:20.555601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] PATH_INFO: `/v3/projects/1f73eac1974f44daa81e1db18f443392` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:20.557497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f73eac1974f44daa81e1db18f443392)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:20.559841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:20.656633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:20.672024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f73eac1974f44daa81e1db18f443392', 'request_id': 'req-944e288c-1ee0-4c17-b4df-aafa23f42880'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:20.678281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f73eac1974f44daa81e1db18f443392', 'request_id': 'req-944e288c-1ee0-4c17-b4df-aafa23f42880'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:20.684698 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f73eac1974f44daa81e1db18f443392', 'request_id': 'req-944e288c-1ee0-4c17-b4df-aafa23f42880'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:20.774204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] The token cache is being invalidate because project 1f73eac1974f44daa81e1db18f443392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:20.783007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:20.783007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:20.783007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1174/2322] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:20 2022] DELETE /identity/v3/projects/1f73eac1974f44daa81e1db18f443392 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:20.783345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5283a-2e71-45ea-80a7-adb391e0d733 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:20.792160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5283a-2e71-45ea-80a7-adb391e0d733 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:20.854216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:20.854858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:20.855135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:20.855413 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] PATH_INFO: `/v3/users/a0a0463d39024ae5a6c22d4e14baa014` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:20.856600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a0463d39024ae5a6c22d4e14baa014)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:20.858736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:21.109823 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a0463d39024ae5a6c22d4e14baa014'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:21.110520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a0463d39024ae5a6c22d4e14baa014'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:21.179516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a0463d39024ae5a6c22d4e14baa014'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:21.188519 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:21.200926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a0463d39024ae5a6c22d4e14baa014'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:21.208687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-92a4a997-9afa-4127-b6d0-b9c9425e96b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a0463d39024ae5a6c22d4e14baa014'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:21.223331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1149/2323] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:06:20 2022] DELETE /identity/v3/users/a0a0463d39024ae5a6c22d4e14baa014 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:21.778692 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:21.780181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:21.794842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e288c-1ee0-4c17-b4df-aafa23f42880 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:21.821664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb3c75-14bc-4bd1-bd89-5d1df76fa305 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:21.821931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb3c75-14bc-4bd1-bd89-5d1df76fa305 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:21.822245 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb3c75-14bc-4bd1-bd89-5d1df76fa305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:21.863103 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-41fb3c75-14bc-4bd1-bd89-5d1df76fa305 None None] MFA Rules not processed for user `ec45d64732fe4aac9fe6b9d6cd04a6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:21.865838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-41fb3c75-14bc-4bd1-bd89-5d1df76fa305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:21.885378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:21.886183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:21.886535 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:21.886879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] PATH_INFO: `/v3/projects/5db9c0aabd354c9a92b4eb5eb15de782` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:21.888397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db9c0aabd354c9a92b4eb5eb15de782)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:21.890581 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:21.984375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1150/2324] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:21.996128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb3c75-14bc-4bd1-bd89-5d1df76fa305 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:21.997778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-41fb3c75-14bc-4bd1-bd89-5d1df76fa305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:22.072102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db9c0aabd354c9a92b4eb5eb15de782', 'request_id': 'req-3d0094f3-813c-4f12-8242-99a285d2a975'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:22.072527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb3c75-14bc-4bd1-bd89-5d1df76fa305 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:22.080937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db9c0aabd354c9a92b4eb5eb15de782', 'request_id': 'req-3d0094f3-813c-4f12-8242-99a285d2a975'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:22.088782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db9c0aabd354c9a92b4eb5eb15de782', 'request_id': 'req-3d0094f3-813c-4f12-8242-99a285d2a975'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:22.152066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bac0c6-ae0a-4d71-aeea-16566b19cd8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:22.152967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bac0c6-ae0a-4d71-aeea-16566b19cd8c service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:22.154206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bac0c6-ae0a-4d71-aeea-16566b19cd8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:22.155395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bac0c6-ae0a-4d71-aeea-16566b19cd8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:22.155788 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] The token cache is being invalidate because project 5db9c0aabd354c9a92b4eb5eb15de782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:22.156488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:22.157347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3d0094f3-813c-4f12-8242-99a285d2a975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:22.159475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1175/2325] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:21 2022] DELETE /identity/v3/projects/5db9c0aabd354c9a92b4eb5eb15de782 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:22.166612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5262-8530-407b-94c4-2f835012fb6e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:22.166988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5262-8530-407b-94c4-2f835012fb6e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:22.167471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5262-8530-407b-94c4-2f835012fb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:22.170506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-61bac0c6-ae0a-4d71-aeea-16566b19cd8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:22.191679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2cbd5262-8530-407b-94c4-2f835012fb6e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:22.193037 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2cbd5262-8530-407b-94c4-2f835012fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:22.251627 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:22.255562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bac0c6-ae0a-4d71-aeea-16566b19cd8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:22.256991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bac0c6-ae0a-4d71-aeea-16566b19cd8c service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:22.283718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1151/2326] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:06:22.306001 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a55b8-475f-41e9-b747-6defcef0e8a6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:22.306207 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1176/2327] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:22.306465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a55b8-475f-41e9-b747-6defcef0e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:22.306799 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a55b8-475f-41e9-b747-6defcef0e8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:22.353934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8c2a55b8-475f-41e9-b747-6defcef0e8a6 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:22.363021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8c2a55b8-475f-41e9-b747-6defcef0e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:22.395500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1152/2328] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:22.401394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5262-8530-407b-94c4-2f835012fb6e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:22.419909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5262-8530-407b-94c4-2f835012fb6e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:22.427343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55469f6-8e42-4268-accc-13ae60d02ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:22.428412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55469f6-8e42-4268-accc-13ae60d02ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:22.428767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55469f6-8e42-4268-accc-13ae60d02ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:22.429407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55469f6-8e42-4268-accc-13ae60d02ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:22.434349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55469f6-8e42-4268-accc-13ae60d02ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:06:22.434932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55469f6-8e42-4268-accc-13ae60d02ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:22.436773 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55469f6-8e42-4268-accc-13ae60d02ae0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:22.464356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1177/2329] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:06:22.470733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a55b8-475f-41e9-b747-6defcef0e8a6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:22.502414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a55b8-475f-41e9-b747-6defcef0e8a6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:22.520633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed43219-2399-4c94-96c6-fa3329d3e107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:22.521672 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43219-2399-4c94-96c6-fa3329d3e107 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:22.522168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43219-2399-4c94-96c6-fa3329d3e107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:22.522944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43219-2399-4c94-96c6-fa3329d3e107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:22.528737 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed43219-2399-4c94-96c6-fa3329d3e107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:22.530929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed43219-2399-4c94-96c6-fa3329d3e107 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:22.754680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1153/2330] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:06:22 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:06:22.760561 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55469f6-8e42-4268-accc-13ae60d02ae0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:22.771411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55469f6-8e42-4268-accc-13ae60d02ae0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:22.802204 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:22.835704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aaa76-5e7b-4205-90cd-30ec2bf47999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:22.836294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aaa76-5e7b-4205-90cd-30ec2bf47999 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:22.836575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aaa76-5e7b-4205-90cd-30ec2bf47999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:22.836979 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aaa76-5e7b-4205-90cd-30ec2bf47999 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:22.838275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aaa76-5e7b-4205-90cd-30ec2bf47999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:22.840237 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aaa76-5e7b-4205-90cd-30ec2bf47999 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:23.089393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1178/2331] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:06:22 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:23.093767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed43219-2399-4c94-96c6-fa3329d3e107 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:23.106832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed43219-2399-4c94-96c6-fa3329d3e107 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:23.112942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306ba19-b29a-4e2c-a2cc-1139c8490e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:23.114164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306ba19-b29a-4e2c-a2cc-1139c8490e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:23.114453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306ba19-b29a-4e2c-a2cc-1139c8490e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:23.114776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306ba19-b29a-4e2c-a2cc-1139c8490e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:23.115491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306ba19-b29a-4e2c-a2cc-1139c8490e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:23.117177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306ba19-b29a-4e2c-a2cc-1139c8490e86 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:23.131526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1154/2332] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:06:23.132751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aaa76-5e7b-4205-90cd-30ec2bf47999 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:23.143422 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aaa76-5e7b-4205-90cd-30ec2bf47999 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:23.148277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75dd58-c70c-42b1-998c-bad52d1953b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:23.149020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75dd58-c70c-42b1-998c-bad52d1953b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:23.149637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75dd58-c70c-42b1-998c-bad52d1953b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:23.150245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75dd58-c70c-42b1-998c-bad52d1953b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:23.151152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75dd58-c70c-42b1-998c-bad52d1953b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:23.152773 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75dd58-c70c-42b1-998c-bad52d1953b1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:23.167274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1179/2333] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:06:23.168722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306ba19-b29a-4e2c-a2cc-1139c8490e86 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:23.178872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306ba19-b29a-4e2c-a2cc-1139c8490e86 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:23.184658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ff273-1d85-405e-8461-3d92cf6d15ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:23.185384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ff273-1d85-405e-8461-3d92cf6d15ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:23.185665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ff273-1d85-405e-8461-3d92cf6d15ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:23.186263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ff273-1d85-405e-8461-3d92cf6d15ab admin admin] PATH_INFO: `/v3/projects/79a8b662d0694e6f982b8c2b755719e2/users/82d1ffc520b6435a8c16187bb351e970/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:23.204595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ff273-1d85-405e-8461-3d92cf6d15ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a8b662d0694e6f982b8c2b755719e2, user_id=82d1ffc520b6435a8c16187bb351e970, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:23.207501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ff273-1d85-405e-8461-3d92cf6d15ab admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:23.284741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1963062-909d-4e9e-8d85-f4503bcf68fa None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:23.285031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1963062-909d-4e9e-8d85-f4503bcf68fa None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:23.285345 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1963062-909d-4e9e-8d85-f4503bcf68fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:23.306181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c1963062-909d-4e9e-8d85-f4503bcf68fa None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:23.307501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c1963062-909d-4e9e-8d85-f4503bcf68fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:23.324275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1155/2334] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:23 2022] PUT /identity/v3/projects/79a8b662d0694e6f982b8c2b755719e2/users/82d1ffc520b6435a8c16187bb351e970/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:23.335707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97332b-0697-4d9f-801c-19ed57f89d50 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:23.336538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97332b-0697-4d9f-801c-19ed57f89d50 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:23.336538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97332b-0697-4d9f-801c-19ed57f89d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:23.395086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1180/2335] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:06:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:23.396099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1963062-909d-4e9e-8d85-f4503bcf68fa None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:23.397531 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c1963062-909d-4e9e-8d85-f4503bcf68fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:23.408310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7d97332b-0697-4d9f-801c-19ed57f89d50 None None] MFA Rules not processed for user `82d1ffc520b6435a8c16187bb351e970`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:23.409200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7d97332b-0697-4d9f-801c-19ed57f89d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:23.531751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1963062-909d-4e9e-8d85-f4503bcf68fa None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:23.603308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1156/2336] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:23.612191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97332b-0697-4d9f-801c-19ed57f89d50 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:23.612191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7d97332b-0697-4d9f-801c-19ed57f89d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:23.668192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859b9cf-4b9c-4fca-ab5e-fd93c58cca8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:23.668192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859b9cf-4b9c-4fca-ab5e-fd93c58cca8e service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:23.668192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859b9cf-4b9c-4fca-ab5e-fd93c58cca8e service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:23.668192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859b9cf-4b9c-4fca-ab5e-fd93c58cca8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:23.732072 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97332b-0697-4d9f-801c-19ed57f89d50 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:23.736612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd37684-ce5e-4152-aa45-9f91c6aab0ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:23.737267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37684-ce5e-4152-aa45-9f91c6aab0ae service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:23.737725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37684-ce5e-4152-aa45-9f91c6aab0ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:23.738147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37684-ce5e-4152-aa45-9f91c6aab0ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:23.748748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd37684-ce5e-4152-aa45-9f91c6aab0ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:23.765105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd37684-ce5e-4152-aa45-9f91c6aab0ae service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:23.782725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1157/2337] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:06:23.793319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859b9cf-4b9c-4fca-ab5e-fd93c58cca8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:23.794953 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859b9cf-4b9c-4fca-ab5e-fd93c58cca8e service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:23.813657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1181/2338] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:06:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:06:24.644854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e772008-ca64-4fbb-a4ba-d49617005097 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:24.645416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e772008-ca64-4fbb-a4ba-d49617005097 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:24.645416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e772008-ca64-4fbb-a4ba-d49617005097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:24.676923 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5e772008-ca64-4fbb-a4ba-d49617005097 None None] MFA Rules not processed for user `ec45d64732fe4aac9fe6b9d6cd04a6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:24.679478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5e772008-ca64-4fbb-a4ba-d49617005097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:24.765286 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1158/2339] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:26.114529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:26.323580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:33.910805 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859b9cf-4b9c-4fca-ab5e-fd93c58cca8e service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:33.913869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d859b9cf-4b9c-4fca-ab5e-fd93c58cca8e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:33.999569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859b9cf-4b9c-4fca-ab5e-fd93c58cca8e service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:34.006081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129a8e2-7e45-4068-ae64-5652e6a1395a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:34.007139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129a8e2-7e45-4068-ae64-5652e6a1395a service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:34.007580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129a8e2-7e45-4068-ae64-5652e6a1395a service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:34.008015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129a8e2-7e45-4068-ae64-5652e6a1395a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:34.010744 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8129a8e2-7e45-4068-ae64-5652e6a1395a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:34.128678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:34.140002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129a8e2-7e45-4068-ae64-5652e6a1395a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:34.141663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129a8e2-7e45-4068-ae64-5652e6a1395a service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:34.153667 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1182/2340] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:34.304371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e772008-ca64-4fbb-a4ba-d49617005097 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:34.306932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5e772008-ca64-4fbb-a4ba-d49617005097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:34.388440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e772008-ca64-4fbb-a4ba-d49617005097 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:34.393293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:34.394009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:34.394280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:34.394529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] PATH_INFO: `/v3/users/d1e28876386a4dbf9f2f6f648f863042` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:34.395902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e28876386a4dbf9f2f6f648f863042)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:34.397900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:34.655048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e28876386a4dbf9f2f6f648f863042'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:34.655832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e28876386a4dbf9f2f6f648f863042'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:34.771885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e28876386a4dbf9f2f6f648f863042'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:34.801393 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e28876386a4dbf9f2f6f648f863042'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:34.827913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e28876386a4dbf9f2f6f648f863042'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:34.844958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1159/2341] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:06:34 2022] DELETE /identity/v3/users/d1e28876386a4dbf9f2f6f648f863042 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:34.850198 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72b2c-1423-49cb-81f4-e568098879b2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:34.850580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72b2c-1423-49cb-81f4-e568098879b2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:34.850940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72b2c-1423-49cb-81f4-e568098879b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:34.885723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7be72b2c-1423-49cb-81f4-e568098879b2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:34.890011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7be72b2c-1423-49cb-81f4-e568098879b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:34.990188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1183/2342] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:35.002396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:35.003400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:35.049525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:35.095989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e618a1-0e92-4f09-9a03-46d3a9cfe4b6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:35.100299 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d05a8-aa98-409d-a186-5ce8aa9c3384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:35.101417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d05a8-aa98-409d-a186-5ce8aa9c3384 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:35.101843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d05a8-aa98-409d-a186-5ce8aa9c3384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:35.102841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d05a8-aa98-409d-a186-5ce8aa9c3384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:35.114970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d05a8-aa98-409d-a186-5ce8aa9c3384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:35.116757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d05a8-aa98-409d-a186-5ce8aa9c3384 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:35.130369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1160/2343] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:36.283530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72b2c-1423-49cb-81f4-e568098879b2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:36.286081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7be72b2c-1423-49cb-81f4-e568098879b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:36.300804 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72b2c-1423-49cb-81f4-e568098879b2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:36.308123 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:36.312386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:36.312386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:36.312386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] PATH_INFO: `/v3/projects/643ba639e7734c94865273faebf937f5` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:36.312386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=643ba639e7734c94865273faebf937f5)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:36.314661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:36.486178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643ba639e7734c94865273faebf937f5', 'request_id': 'req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:36.496443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643ba639e7734c94865273faebf937f5', 'request_id': 'req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:36.503192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643ba639e7734c94865273faebf937f5', 'request_id': 'req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:36.603420 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] The token cache is being invalidate because project 643ba639e7734c94865273faebf937f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:36.603805 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:36.604480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d9e8b97-0024-41c6-9ff9-0cc26fcd1fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:36.609641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1184/2344] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:36 2022] DELETE /identity/v3/projects/643ba639e7734c94865273faebf937f5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:36.611960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdc6ed-31a4-4cde-b851-f3a81bb6edfc None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:36.612490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdc6ed-31a4-4cde-b851-f3a81bb6edfc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:36.612490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdc6ed-31a4-4cde-b851-f3a81bb6edfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:36.635081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8fbdc6ed-31a4-4cde-b851-f3a81bb6edfc None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:36.636235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8fbdc6ed-31a4-4cde-b851-f3a81bb6edfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:36.716517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1161/2345] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:36.722113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67550f-2ce6-46db-8d96-3d327e019174 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:36.722409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67550f-2ce6-46db-8d96-3d327e019174 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:36.723009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67550f-2ce6-46db-8d96-3d327e019174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:36.772702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9e67550f-2ce6-46db-8d96-3d327e019174 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:36.774264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9e67550f-2ce6-46db-8d96-3d327e019174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:36.784901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1185/2346] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:36.791387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdc6ed-31a4-4cde-b851-f3a81bb6edfc None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:36.801295 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdc6ed-31a4-4cde-b851-f3a81bb6edfc None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:36.810179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967784ae-97ca-44fb-8234-94bc7c147281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:36.810814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967784ae-97ca-44fb-8234-94bc7c147281 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:36.811094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967784ae-97ca-44fb-8234-94bc7c147281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:36.811369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967784ae-97ca-44fb-8234-94bc7c147281 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:36.812120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967784ae-97ca-44fb-8234-94bc7c147281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:06:36.812560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967784ae-97ca-44fb-8234-94bc7c147281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:36.814296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967784ae-97ca-44fb-8234-94bc7c147281 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:36.828539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1162/2347] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:06:36.832924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67550f-2ce6-46db-8d96-3d327e019174 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:36.843827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67550f-2ce6-46db-8d96-3d327e019174 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:36.849880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c4f87-72c0-4f79-9b83-c9e802e787fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:36.850619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c4f87-72c0-4f79-9b83-c9e802e787fb admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:36.851128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c4f87-72c0-4f79-9b83-c9e802e787fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:36.851274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c4f87-72c0-4f79-9b83-c9e802e787fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:36.852492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c4f87-72c0-4f79-9b83-c9e802e787fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:36.855101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c4f87-72c0-4f79-9b83-c9e802e787fb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:36.988359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1186/2348] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:06:36 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:36.989689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967784ae-97ca-44fb-8234-94bc7c147281 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:37.002501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967784ae-97ca-44fb-8234-94bc7c147281 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:37.082452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c1892-d8a5-4df6-956a-b0ac3c96e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:37.082452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c1892-d8a5-4df6-956a-b0ac3c96e983 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:37.082452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c1892-d8a5-4df6-956a-b0ac3c96e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:37.082452 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c1892-d8a5-4df6-956a-b0ac3c96e983 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:37.082871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c1892-d8a5-4df6-956a-b0ac3c96e983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:37.082871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c1892-d8a5-4df6-956a-b0ac3c96e983 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:37.202385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c4f87-72c0-4f79-9b83-c9e802e787fb admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:37.206478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-213c4f87-72c0-4f79-9b83-c9e802e787fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:37.214216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1163/2349] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:06:36 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:37.217290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c1892-d8a5-4df6-956a-b0ac3c96e983 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:37.219748 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c4f87-72c0-4f79-9b83-c9e802e787fb admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:37.224700 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:37.225528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:37.225854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:37.226199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] PATH_INFO: `/v3/users/82d1ffc520b6435a8c16187bb351e970` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:37.228025 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d1ffc520b6435a8c16187bb351e970)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:37.230218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c1892-d8a5-4df6-956a-b0ac3c96e983 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:37.233333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:37.236284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19642889-5ac4-4a02-b0ff-5185c26bf5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:37.236994 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642889-5ac4-4a02-b0ff-5185c26bf5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:37.237354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642889-5ac4-4a02-b0ff-5185c26bf5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:37.241828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642889-5ac4-4a02-b0ff-5185c26bf5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:37.241828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19642889-5ac4-4a02-b0ff-5185c26bf5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:37.241828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19642889-5ac4-4a02-b0ff-5185c26bf5f1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:37.259677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1164/2350] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:06:37.263531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19642889-5ac4-4a02-b0ff-5185c26bf5f1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:37.288297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19642889-5ac4-4a02-b0ff-5185c26bf5f1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:37.298082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53008a79-61d5-4f87-bfe5-f86dc110fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:37.298954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008a79-61d5-4f87-bfe5-f86dc110fb78 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:37.299239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008a79-61d5-4f87-bfe5-f86dc110fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:37.299517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008a79-61d5-4f87-bfe5-f86dc110fb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:37.300224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53008a79-61d5-4f87-bfe5-f86dc110fb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:37.301971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53008a79-61d5-4f87-bfe5-f86dc110fb78 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:37.314832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1165/2351] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:06:37.318650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53008a79-61d5-4f87-bfe5-f86dc110fb78 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:37.330233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53008a79-61d5-4f87-bfe5-f86dc110fb78 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:37.335980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41f623-aa4d-463f-8ad1-7ed2bb6c63f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:37.337715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41f623-aa4d-463f-8ad1-7ed2bb6c63f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:37.338014 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41f623-aa4d-463f-8ad1-7ed2bb6c63f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:37.338345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41f623-aa4d-463f-8ad1-7ed2bb6c63f3 admin admin] PATH_INFO: `/v3/projects/312ec150f9db41ed95d18b90cdd3ca6e/users/73522376e8264fa3b417b50a780f1376/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:37.375766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41f623-aa4d-463f-8ad1-7ed2bb6c63f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312ec150f9db41ed95d18b90cdd3ca6e, user_id=73522376e8264fa3b417b50a780f1376, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:37.379961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41f623-aa4d-463f-8ad1-7ed2bb6c63f3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:37.446880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:37.452690 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d1ffc520b6435a8c16187bb351e970'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:37.460061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d1ffc520b6435a8c16187bb351e970'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:37.483463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1166/2352] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:37 2022] PUT /identity/v3/projects/312ec150f9db41ed95d18b90cdd3ca6e/users/73522376e8264fa3b417b50a780f1376/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:06:37.495306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98e89-6f56-456d-b60b-379d12375090 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:37.495668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98e89-6f56-456d-b60b-379d12375090 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:37.495853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98e89-6f56-456d-b60b-379d12375090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:37.509923 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:37.525231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-54c98e89-6f56-456d-b60b-379d12375090 None None] MFA Rules not processed for user `73522376e8264fa3b417b50a780f1376`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:37.526890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-54c98e89-6f56-456d-b60b-379d12375090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:37.592459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1167/2353] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:37.604440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c98e89-6f56-456d-b60b-379d12375090 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:37.605788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-54c98e89-6f56-456d-b60b-379d12375090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:37.636585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d1ffc520b6435a8c16187bb351e970'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:37.637577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d1ffc520b6435a8c16187bb351e970'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:37.638687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af3bfac4-3516-4ae5-bf6d-de303a2f3ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d1ffc520b6435a8c16187bb351e970'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:37.660032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1187/2354] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:06:37 2022] DELETE /identity/v3/users/82d1ffc520b6435a8c16187bb351e970 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:37.664856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28291d8b-2889-4155-9911-f8cdf2385cc0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:37.665285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28291d8b-2889-4155-9911-f8cdf2385cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:37.665571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28291d8b-2889-4155-9911-f8cdf2385cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:37.681780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c98e89-6f56-456d-b60b-379d12375090 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:37.689151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-28291d8b-2889-4155-9911-f8cdf2385cc0 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:37.690477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-28291d8b-2889-4155-9911-f8cdf2385cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:37.801765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e158c4-4c70-48fe-9ee1-64c9a8d79602 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a911a544e17e4fafb579da66973c431f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:37.802711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e158c4-4c70-48fe-9ee1-64c9a8d79602 service glance] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:37.803557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e158c4-4c70-48fe-9ee1-64c9a8d79602 service glance] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:37.804437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e158c4-4c70-48fe-9ee1-64c9a8d79602 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:37.809164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0e158c4-4c70-48fe-9ee1-64c9a8d79602 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:37.820342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1188/2355] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:37.893361 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28291d8b-2889-4155-9911-f8cdf2385cc0 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:37.895269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-28291d8b-2889-4155-9911-f8cdf2385cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:37.921702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e158c4-4c70-48fe-9ee1-64c9a8d79602 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:37.923200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e158c4-4c70-48fe-9ee1-64c9a8d79602 service glance] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:37.946334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1168/2356] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:06:38.011354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28291d8b-2889-4155-9911-f8cdf2385cc0 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:38.016013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cdd41-b153-49b2-8b76-f9f566ddac45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:38.016644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cdd41-b153-49b2-8b76-f9f566ddac45 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:38.017048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cdd41-b153-49b2-8b76-f9f566ddac45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:38.017429 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cdd41-b153-49b2-8b76-f9f566ddac45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:38.040128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cdd41-b153-49b2-8b76-f9f566ddac45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:38.041897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cdd41-b153-49b2-8b76-f9f566ddac45 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:38.054534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1189/2357] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:39.163894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e158c4-4c70-48fe-9ee1-64c9a8d79602 service glance] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:39.166450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0e158c4-4c70-48fe-9ee1-64c9a8d79602 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:39.186499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e158c4-4c70-48fe-9ee1-64c9a8d79602 service glance] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:39.192783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:39.193571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:39.194012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:39.194253 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] PATH_INFO: `/v3/projects/79a8b662d0694e6f982b8c2b755719e2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:39.195525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a8b662d0694e6f982b8c2b755719e2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:39.199034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:39.201164 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:39.439838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a8b662d0694e6f982b8c2b755719e2', 'request_id': 'req-b628c7fc-d712-48bb-9dc9-77df8d89a34e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:39.450234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a8b662d0694e6f982b8c2b755719e2', 'request_id': 'req-b628c7fc-d712-48bb-9dc9-77df8d89a34e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:39.556970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a8b662d0694e6f982b8c2b755719e2', 'request_id': 'req-b628c7fc-d712-48bb-9dc9-77df8d89a34e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:39.573402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] The token cache is being invalidate because project 79a8b662d0694e6f982b8c2b755719e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:39.573402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:39.574129 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b628c7fc-d712-48bb-9dc9-77df8d89a34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:39.581575 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192bc5d-033d-4481-97b7-4c0fc7a10724 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:39.582120 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192bc5d-033d-4481-97b7-4c0fc7a10724 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:39.582558 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192bc5d-033d-4481-97b7-4c0fc7a10724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:39.586121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1169/2358] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:39 2022] DELETE /identity/v3/projects/79a8b662d0694e6f982b8c2b755719e2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:39.604996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0192bc5d-033d-4481-97b7-4c0fc7a10724 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:39.607122 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0192bc5d-033d-4481-97b7-4c0fc7a10724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:39.718368 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1190/2359] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:39.727754 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7673-c119-495b-a5c4-c6b234be025a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:39.728034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7673-c119-495b-a5c4-c6b234be025a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:39.728318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7673-c119-495b-a5c4-c6b234be025a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:39.748675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bb8c7673-c119-495b-a5c4-c6b234be025a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:39.749568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bb8c7673-c119-495b-a5c4-c6b234be025a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:39.764971 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192bc5d-033d-4481-97b7-4c0fc7a10724 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:39.765775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1170/2360] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:39.769942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:39.777421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192bc5d-033d-4481-97b7-4c0fc7a10724 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:39.782255 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed736-7a6d-42fa-9b71-4001b612b6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:39.783051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed736-7a6d-42fa-9b71-4001b612b6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:39.783373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed736-7a6d-42fa-9b71-4001b612b6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:39.783743 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed736-7a6d-42fa-9b71-4001b612b6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:39.784914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fed736-7a6d-42fa-9b71-4001b612b6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:06:39.784914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fed736-7a6d-42fa-9b71-4001b612b6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:39.786859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fed736-7a6d-42fa-9b71-4001b612b6d3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:39.804738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c7673-c119-495b-a5c4-c6b234be025a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:39.809554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1191/2361] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:06:39.820239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c7673-c119-495b-a5c4-c6b234be025a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:39.834943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a71bb0-8186-47a0-9b3e-32f8f9c1fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:39.835588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a71bb0-8186-47a0-9b3e-32f8f9c1fb27 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:39.837358 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a71bb0-8186-47a0-9b3e-32f8f9c1fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:39.837675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a71bb0-8186-47a0-9b3e-32f8f9c1fb27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:39.838684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a71bb0-8186-47a0-9b3e-32f8f9c1fb27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:39.845317 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a71bb0-8186-47a0-9b3e-32f8f9c1fb27 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:40.018186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1171/2362] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:06:39 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:40.027449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed736-7a6d-42fa-9b71-4001b612b6d3 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:40.049490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed736-7a6d-42fa-9b71-4001b612b6d3 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:40.179727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75248c-af52-44d9-bcde-f801e873678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:40.181618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75248c-af52-44d9-bcde-f801e873678c admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:40.181969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75248c-af52-44d9-bcde-f801e873678c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:40.185906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75248c-af52-44d9-bcde-f801e873678c admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:40.187193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75248c-af52-44d9-bcde-f801e873678c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:40.190832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75248c-af52-44d9-bcde-f801e873678c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:40.304670 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1192/2363] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:06:40 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:40.304914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a71bb0-8186-47a0-9b3e-32f8f9c1fb27 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:40.317365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a71bb0-8186-47a0-9b3e-32f8f9c1fb27 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:40.325025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63396907-6fff-4750-a487-6ccfd902ab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:40.326111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63396907-6fff-4750-a487-6ccfd902ab4f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:40.326404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63396907-6fff-4750-a487-6ccfd902ab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:40.326686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63396907-6fff-4750-a487-6ccfd902ab4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:40.327547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63396907-6fff-4750-a487-6ccfd902ab4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:40.329250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63396907-6fff-4750-a487-6ccfd902ab4f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:40.345702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1172/2364] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:06:40.351545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75248c-af52-44d9-bcde-f801e873678c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:40.379714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75248c-af52-44d9-bcde-f801e873678c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:40.401262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bd39c-22e8-4758-bb1e-c24cb0272870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:40.402611 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bd39c-22e8-4758-bb1e-c24cb0272870 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:40.402918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bd39c-22e8-4758-bb1e-c24cb0272870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:40.406926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bd39c-22e8-4758-bb1e-c24cb0272870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:40.406926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bd39c-22e8-4758-bb1e-c24cb0272870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:40.406926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bd39c-22e8-4758-bb1e-c24cb0272870 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:40.430233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63396907-6fff-4750-a487-6ccfd902ab4f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:40.430443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1193/2365] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:06:40.443664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63396907-6fff-4750-a487-6ccfd902ab4f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:40.449503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03516206-dd9e-431e-b5a9-b10c0f614abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:40.451114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03516206-dd9e-431e-b5a9-b10c0f614abd admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:40.451114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03516206-dd9e-431e-b5a9-b10c0f614abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:40.451114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03516206-dd9e-431e-b5a9-b10c0f614abd admin admin] PATH_INFO: `/v3/projects/d8acf2f3cf864c6d90a1a6dfe0c69b84/users/224041fc76f34540bc1bb494e7e767c3/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:40.476057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03516206-dd9e-431e-b5a9-b10c0f614abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8acf2f3cf864c6d90a1a6dfe0c69b84, user_id=224041fc76f34540bc1bb494e7e767c3, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:40.480990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03516206-dd9e-431e-b5a9-b10c0f614abd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:40.582760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1173/2366] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:40 2022] PUT /identity/v3/projects/d8acf2f3cf864c6d90a1a6dfe0c69b84/users/224041fc76f34540bc1bb494e7e767c3/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:06:40.594672 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1ca2-f368-4925-85af-cb4afc215196 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:40.595143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1ca2-f368-4925-85af-cb4afc215196 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:40.595311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1ca2-f368-4925-85af-cb4afc215196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:40.638511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-033f1ca2-f368-4925-85af-cb4afc215196 None None] MFA Rules not processed for user `224041fc76f34540bc1bb494e7e767c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:40.640024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-033f1ca2-f368-4925-85af-cb4afc215196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:40.759048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1194/2367] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:40.764714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03516206-dd9e-431e-b5a9-b10c0f614abd admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:40.877786 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03516206-dd9e-431e-b5a9-b10c0f614abd admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:40.887837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d825358-ab9d-41c7-8a38-f4d35fe156a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:40.888542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d825358-ab9d-41c7-8a38-f4d35fe156a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:40.888833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d825358-ab9d-41c7-8a38-f4d35fe156a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:40.889113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d825358-ab9d-41c7-8a38-f4d35fe156a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:40.889833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d825358-ab9d-41c7-8a38-f4d35fe156a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:40.891889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d825358-ab9d-41c7-8a38-f4d35fe156a4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:40.992576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1174/2368] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:06:40 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:40.996651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f1ca2-f368-4925-85af-cb4afc215196 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:41.008775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f1ca2-f368-4925-85af-cb4afc215196 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:41.076825 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e345f90-ba0f-41ac-9db5-547faf47fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:41.077487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e345f90-ba0f-41ac-9db5-547faf47fa21 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:41.077769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e345f90-ba0f-41ac-9db5-547faf47fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:41.078044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e345f90-ba0f-41ac-9db5-547faf47fa21 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:41.078722 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e345f90-ba0f-41ac-9db5-547faf47fa21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:41.080699 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e345f90-ba0f-41ac-9db5-547faf47fa21 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:41.209441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1195/2369] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:06:40 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:41.214502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d825358-ab9d-41c7-8a38-f4d35fe156a4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:41.226546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d825358-ab9d-41c7-8a38-f4d35fe156a4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:41.235866 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27a63a-ce11-4704-8e73-c22747d882bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:41.236595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27a63a-ce11-4704-8e73-c22747d882bd admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:41.236878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27a63a-ce11-4704-8e73-c22747d882bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:41.237236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27a63a-ce11-4704-8e73-c22747d882bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:41.237989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27a63a-ce11-4704-8e73-c22747d882bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:41.239741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27a63a-ce11-4704-8e73-c22747d882bd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:41.251175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:41.260947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1175/2370] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:06:41.265564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e345f90-ba0f-41ac-9db5-547faf47fa21 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:41.291150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e345f90-ba0f-41ac-9db5-547faf47fa21 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:41.300425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a7d44-d035-4b8e-92db-333aad31a5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:41.302469 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7d44-d035-4b8e-92db-333aad31a5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:41.306986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7d44-d035-4b8e-92db-333aad31a5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:41.308260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7d44-d035-4b8e-92db-333aad31a5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:41.310621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a7d44-d035-4b8e-92db-333aad31a5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:41.312961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a7d44-d035-4b8e-92db-333aad31a5b5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:41.334716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1196/2371] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:06:41.338747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27a63a-ce11-4704-8e73-c22747d882bd admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:41.349932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27a63a-ce11-4704-8e73-c22747d882bd admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:41.355507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3c0e6-ba0a-4582-bd0d-9ffe7e5ed8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:41.356517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3c0e6-ba0a-4582-bd0d-9ffe7e5ed8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:41.357079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3c0e6-ba0a-4582-bd0d-9ffe7e5ed8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:41.357646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3c0e6-ba0a-4582-bd0d-9ffe7e5ed8ce admin admin] PATH_INFO: `/v3/projects/6c0a45f2f5184597aa55520f2d86f307/users/229fe50ba663455686db9df3805f8f1f/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:41.379381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3c0e6-ba0a-4582-bd0d-9ffe7e5ed8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c0a45f2f5184597aa55520f2d86f307, user_id=229fe50ba663455686db9df3805f8f1f, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:41.382093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3c0e6-ba0a-4582-bd0d-9ffe7e5ed8ce admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:41.478936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1176/2372] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:41 2022] PUT /identity/v3/projects/6c0a45f2f5184597aa55520f2d86f307/users/229fe50ba663455686db9df3805f8f1f/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:41.490449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aa286-7816-4295-89e7-c97f4939f98f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:41.490861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aa286-7816-4295-89e7-c97f4939f98f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:41.491148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aa286-7816-4295-89e7-c97f4939f98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:41.539338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b65aa286-7816-4295-89e7-c97f4939f98f None None] MFA Rules not processed for user `229fe50ba663455686db9df3805f8f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:41.540517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b65aa286-7816-4295-89e7-c97f4939f98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:41.626078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1197/2373] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:41.631094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3c0e6-ba0a-4582-bd0d-9ffe7e5ed8ce admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:41.721143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3c0e6-ba0a-4582-bd0d-9ffe7e5ed8ce admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:41.732652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4ac4-23bf-4575-b84f-e7f2d5578861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:41.733331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4ac4-23bf-4575-b84f-e7f2d5578861 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:41.733616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4ac4-23bf-4575-b84f-e7f2d5578861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:41.733910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4ac4-23bf-4575-b84f-e7f2d5578861 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:41.734608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a4ac4-23bf-4575-b84f-e7f2d5578861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:41.736571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a4ac4-23bf-4575-b84f-e7f2d5578861 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:41.873474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1177/2374] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:06:41 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:06:41.878010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aa286-7816-4295-89e7-c97f4939f98f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:41.902589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aa286-7816-4295-89e7-c97f4939f98f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:41.997860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d33d2-3423-44e8-a388-2f1d8c7a5959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:41.998518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d33d2-3423-44e8-a388-2f1d8c7a5959 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:41.998806 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d33d2-3423-44e8-a388-2f1d8c7a5959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:41.999583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d33d2-3423-44e8-a388-2f1d8c7a5959 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:41.999940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d33d2-3423-44e8-a388-2f1d8c7a5959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:42.002028 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d33d2-3423-44e8-a388-2f1d8c7a5959 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:42.107525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1198/2375] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:06:41 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:06:42.111401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4ac4-23bf-4575-b84f-e7f2d5578861 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:42.122926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4ac4-23bf-4575-b84f-e7f2d5578861 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:42.130700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7321f-fbf2-40b9-a57f-38a239b9b469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:42.131321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7321f-fbf2-40b9-a57f-38a239b9b469 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:42.131625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7321f-fbf2-40b9-a57f-38a239b9b469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:42.131884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7321f-fbf2-40b9-a57f-38a239b9b469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:42.132633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7321f-fbf2-40b9-a57f-38a239b9b469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:42.134431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7321f-fbf2-40b9-a57f-38a239b9b469 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:42.147965 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1178/2376] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:06:42.152713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d33d2-3423-44e8-a388-2f1d8c7a5959 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:42.166492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d33d2-3423-44e8-a388-2f1d8c7a5959 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:42.172181 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43608471-a4c7-4b56-8d66-bd43c636a142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:42.173016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43608471-a4c7-4b56-8d66-bd43c636a142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:42.173434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43608471-a4c7-4b56-8d66-bd43c636a142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:42.173812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43608471-a4c7-4b56-8d66-bd43c636a142 admin admin] PATH_INFO: `/v3/projects/b35c7ebc857843aea4bfbfc11fb7b4d0/users/d1fe3dd197984dc09b8c1892f4b8439f/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:42.191335 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43608471-a4c7-4b56-8d66-bd43c636a142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35c7ebc857843aea4bfbfc11fb7b4d0, user_id=d1fe3dd197984dc09b8c1892f4b8439f, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:42.196376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43608471-a4c7-4b56-8d66-bd43c636a142 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:42.294975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:42.297359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7321f-fbf2-40b9-a57f-38a239b9b469 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:42.307817 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1199/2377] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:42 2022] PUT /identity/v3/projects/b35c7ebc857843aea4bfbfc11fb7b4d0/users/d1fe3dd197984dc09b8c1892f4b8439f/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:42.312860 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7321f-fbf2-40b9-a57f-38a239b9b469 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:42.422812 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268b5cb-284d-4039-9b00-755ac714fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:42.424486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268b5cb-284d-4039-9b00-755ac714fff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:42.424773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268b5cb-284d-4039-9b00-755ac714fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:42.425049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268b5cb-284d-4039-9b00-755ac714fff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:42.425822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268b5cb-284d-4039-9b00-755ac714fff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:42.427735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268b5cb-284d-4039-9b00-755ac714fff4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:42.449271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1179/2378] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:06:42.449737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43608471-a4c7-4b56-8d66-bd43c636a142 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:42.462723 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43608471-a4c7-4b56-8d66-bd43c636a142 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:42.468896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80120ae7-4bf6-495a-9efd-f5d1fa7ac238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:42.472075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120ae7-4bf6-495a-9efd-f5d1fa7ac238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:42.472075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120ae7-4bf6-495a-9efd-f5d1fa7ac238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:42.472075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120ae7-4bf6-495a-9efd-f5d1fa7ac238 admin admin] PATH_INFO: `/v3/projects/b35c7ebc857843aea4bfbfc11fb7b4d0/users/d1fe3dd197984dc09b8c1892f4b8439f/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:42.472365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80120ae7-4bf6-495a-9efd-f5d1fa7ac238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35c7ebc857843aea4bfbfc11fb7b4d0, user_id=d1fe3dd197984dc09b8c1892f4b8439f, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:42.479705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80120ae7-4bf6-495a-9efd-f5d1fa7ac238 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:42.501975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1200/2379] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:06:42 2022] PUT /identity/v3/projects/b35c7ebc857843aea4bfbfc11fb7b4d0/users/d1fe3dd197984dc09b8c1892f4b8439f/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:06:42.504342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936ee0-7ca0-40d4-aeb8-faf9f8f5d1b2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:42.504631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936ee0-7ca0-40d4-aeb8-faf9f8f5d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:42.504907 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936ee0-7ca0-40d4-aeb8-faf9f8f5d1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:42.537693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-cc936ee0-7ca0-40d4-aeb8-faf9f8f5d1b2 None None] MFA Rules not processed for user `d1fe3dd197984dc09b8c1892f4b8439f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:42.539801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cc936ee0-7ca0-40d4-aeb8-faf9f8f5d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:42.679095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1180/2380] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:42.693176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80120ae7-4bf6-495a-9efd-f5d1fa7ac238 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:42.695434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-80120ae7-4bf6-495a-9efd-f5d1fa7ac238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:42.801339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80120ae7-4bf6-495a-9efd-f5d1fa7ac238 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:42.811092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46303c-ed8c-4ee4-9f12-c2b218b2e067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:42.811904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46303c-ed8c-4ee4-9f12-c2b218b2e067 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:42.813073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46303c-ed8c-4ee4-9f12-c2b218b2e067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:42.813454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46303c-ed8c-4ee4-9f12-c2b218b2e067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:42.918519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46303c-ed8c-4ee4-9f12-c2b218b2e067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:42.919988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46303c-ed8c-4ee4-9f12-c2b218b2e067 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:42.934446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1201/2381] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:43.507474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:43.754083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:45.406567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc936ee0-7ca0-40d4-aeb8-faf9f8f5d1b2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:45.420046 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc936ee0-7ca0-40d4-aeb8-faf9f8f5d1b2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:45.427466 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106da1e-f999-4328-80e5-ff95af33a6a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:45.428547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106da1e-f999-4328-80e5-ff95af33a6a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:45.429261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106da1e-f999-4328-80e5-ff95af33a6a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:45.430655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106da1e-f999-4328-80e5-ff95af33a6a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:45.526027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106da1e-f999-4328-80e5-ff95af33a6a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:45.527874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106da1e-f999-4328-80e5-ff95af33a6a7 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:45.539226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1181/2382] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:45.828066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76c86f-3928-4c81-812c-1cb451f017c6 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:45.828794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76c86f-3928-4c81-812c-1cb451f017c6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:45.828794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76c86f-3928-4c81-812c-1cb451f017c6 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:45.830362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1202/2383] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 23:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:06:45.838293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7def58-f999-4025-b7df-1cb62c401bd1 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:45.838506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7def58-f999-4025-b7df-1cb62c401bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:45.838788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7def58-f999-4025-b7df-1cb62c401bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:45.871251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3a7def58-f999-4025-b7df-1cb62c401bd1 None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:45.872557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3a7def58-f999-4025-b7df-1cb62c401bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:45.974657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1182/2384] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 23:06:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:45.994489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76c86f-3928-4c81-812c-1cb451f017c6 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:45.996794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1e76c86f-3928-4c81-812c-1cb451f017c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:46.087757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76c86f-3928-4c81-812c-1cb451f017c6 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:46.092257 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae31c5-e4e0-4d63-9594-3412eaebbda3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a911a544e17e4fafb579da66973c431f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:46.093441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae31c5-e4e0-4d63-9594-3412eaebbda3 service glance] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:46.093782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae31c5-e4e0-4d63-9594-3412eaebbda3 service glance] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:46.094959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae31c5-e4e0-4d63-9594-3412eaebbda3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:46.113834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae31c5-e4e0-4d63-9594-3412eaebbda3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:46.116506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae31c5-e4e0-4d63-9594-3412eaebbda3 service glance] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:46.130750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1203/2385] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:06:46.352368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a412070-32c0-4a3e-954f-a8739b197baf None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:46.352914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a412070-32c0-4a3e-954f-a8739b197baf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:46.353826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a412070-32c0-4a3e-954f-a8739b197baf None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:46.355443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1183/2386] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 23:06:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:06:46.362361 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819387-a312-4094-acd7-539c06f52d98 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:46.363883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819387-a312-4094-acd7-539c06f52d98 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:46.363883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819387-a312-4094-acd7-539c06f52d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:46.395585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e0819387-a312-4094-acd7-539c06f52d98 None None] MFA Rules not processed for user `aa8cd52bd9f24f7d8ed93943aaaeaa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:46.398142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e0819387-a312-4094-acd7-539c06f52d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:46.459339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1204/2387] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 23:06:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:46.472458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a412070-32c0-4a3e-954f-a8739b197baf None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:46.474701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7a412070-32c0-4a3e-954f-a8739b197baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:46.500575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a412070-32c0-4a3e-954f-a8739b197baf None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:46.516067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b77a3-0988-4716-b60d-e17b5ed8b77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:46.517056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b77a3-0988-4716-b60d-e17b5ed8b77c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:46.517579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b77a3-0988-4716-b60d-e17b5ed8b77c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:46.518248 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b77a3-0988-4716-b60d-e17b5ed8b77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:46.535133 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b77a3-0988-4716-b60d-e17b5ed8b77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:46.539710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b77a3-0988-4716-b60d-e17b5ed8b77c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:46.551900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1184/2388] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:46.647966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5e59-7fa7-46fe-816a-5575352bfb74 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:46.649156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5e59-7fa7-46fe-816a-5575352bfb74 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:46.649644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5e59-7fa7-46fe-816a-5575352bfb74 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:46.651585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1205/2389] 10.222.0.55 () {54 vars in 921 bytes} [Mon Jul 25 23:06:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:06:46.657539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd45a-13b0-4e36-924c-3f93b44cfe99 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:46.658037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd45a-13b0-4e36-924c-3f93b44cfe99 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:46.658324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd45a-13b0-4e36-924c-3f93b44cfe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:46.680669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7e6bd45a-13b0-4e36-924c-3f93b44cfe99 None None] MFA Rules not processed for user `eea60163008a4bea95d130a5809fc50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:46.681992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7e6bd45a-13b0-4e36-924c-3f93b44cfe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:46.692301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1185/2390] 10.222.0.55 () {58 vars in 1018 bytes} [Mon Jul 25 23:06:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:46.706797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd5e59-7fa7-46fe-816a-5575352bfb74 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:46.721066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd5e59-7fa7-46fe-816a-5575352bfb74 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:46.725811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852c5be-c37d-410e-9895-2cf9bba7bd57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:46.726524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852c5be-c37d-410e-9895-2cf9bba7bd57 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:46.726873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852c5be-c37d-410e-9895-2cf9bba7bd57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:46.727219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852c5be-c37d-410e-9895-2cf9bba7bd57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:46.741191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852c5be-c37d-410e-9895-2cf9bba7bd57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:46.743013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852c5be-c37d-410e-9895-2cf9bba7bd57 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:46.758768 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1206/2391] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:47.220332 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd45a-13b0-4e36-924c-3f93b44cfe99 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:47.243622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd45a-13b0-4e36-924c-3f93b44cfe99 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:47.247614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e71c1-04e3-4690-a768-f28fd98fcb43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:47.248342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e71c1-04e3-4690-a768-f28fd98fcb43 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:47.248634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e71c1-04e3-4690-a768-f28fd98fcb43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:47.248931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e71c1-04e3-4690-a768-f28fd98fcb43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:47.263860 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e71c1-04e3-4690-a768-f28fd98fcb43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:47.265548 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e71c1-04e3-4690-a768-f28fd98fcb43 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:47.280461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1186/2392] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:52.122011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852c5be-c37d-410e-9895-2cf9bba7bd57 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:52.149733 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:52.225512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852c5be-c37d-410e-9895-2cf9bba7bd57 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:52.231766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:52.232529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:52.232915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:52.233310 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] PATH_INFO: `/v3/users/224041fc76f34540bc1bb494e7e767c3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:52.234811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=224041fc76f34540bc1bb494e7e767c3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:52.237850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:52.422530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224041fc76f34540bc1bb494e7e767c3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:52.429662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224041fc76f34540bc1bb494e7e767c3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:52.493338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224041fc76f34540bc1bb494e7e767c3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:52.494116 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224041fc76f34540bc1bb494e7e767c3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:52.494824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224041fc76f34540bc1bb494e7e767c3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:52.518547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1207/2393] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:06:52 2022] DELETE /identity/v3/users/224041fc76f34540bc1bb494e7e767c3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:52.523650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13035d-592f-4891-a36a-5859afa847b4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:52.524203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13035d-592f-4891-a36a-5859afa847b4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:52.524203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13035d-592f-4891-a36a-5859afa847b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:52.543754 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4c13035d-592f-4891-a36a-5859afa847b4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:52.544963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4c13035d-592f-4891-a36a-5859afa847b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:52.571075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:52.615479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1187/2394] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:52.625936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:52.627602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:52.697883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2824d1-d563-414f-ab9e-1f0e10dc59ad admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:52.701732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aaaec5-1cd9-4385-b334-16244a3a90eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:52.702369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaaec5-1cd9-4385-b334-16244a3a90eb service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:52.702677 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaaec5-1cd9-4385-b334-16244a3a90eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:52.702957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaaec5-1cd9-4385-b334-16244a3a90eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:52.713379 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aaaec5-1cd9-4385-b334-16244a3a90eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:52.714837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aaaec5-1cd9-4385-b334-16244a3a90eb service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:52.725715 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1208/2395] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:06:53.206668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13035d-592f-4891-a36a-5859afa847b4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:53.210010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4c13035d-592f-4891-a36a-5859afa847b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:53.229810 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13035d-592f-4891-a36a-5859afa847b4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:53.237278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:53.237944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:53.238225 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:53.238496 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] PATH_INFO: `/v3/projects/d8acf2f3cf864c6d90a1a6dfe0c69b84` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:53.239711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8acf2f3cf864c6d90a1a6dfe0c69b84)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:53.241811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:53.248765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404dc93-c62a-4a82-af30-fdf21489e472 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:53.249291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404dc93-c62a-4a82-af30-fdf21489e472 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:53.249484 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404dc93-c62a-4a82-af30-fdf21489e472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:53.275540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d404dc93-c62a-4a82-af30-fdf21489e472 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:53.277494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d404dc93-c62a-4a82-af30-fdf21489e472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:53.319353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:53.346984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1209/2396] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:06:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:06:53.360046 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404dc93-c62a-4a82-af30-fdf21489e472 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:53.361416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d404dc93-c62a-4a82-af30-fdf21489e472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:53.409392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8acf2f3cf864c6d90a1a6dfe0c69b84', 'request_id': 'req-5a563483-5d68-4113-be44-5579339b2ef7'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:53.416569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8acf2f3cf864c6d90a1a6dfe0c69b84', 'request_id': 'req-5a563483-5d68-4113-be44-5579339b2ef7'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:53.435680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404dc93-c62a-4a82-af30-fdf21489e472 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:53.497478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1a909-444e-49e3-93ce-3e0142c46c32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:53.498163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1a909-444e-49e3-93ce-3e0142c46c32 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:53.498449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1a909-444e-49e3-93ce-3e0142c46c32 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:53.498722 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1a909-444e-49e3-93ce-3e0142c46c32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:53.504475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8acf2f3cf864c6d90a1a6dfe0c69b84', 'request_id': 'req-5a563483-5d68-4113-be44-5579339b2ef7'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:53.517402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] The token cache is being invalidate because project d8acf2f3cf864c6d90a1a6dfe0c69b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:53.517701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:53.518373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:53.519940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1188/2397] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:53 2022] DELETE /identity/v3/projects/d8acf2f3cf864c6d90a1a6dfe0c69b84 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:53.523808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:53.525675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:53.574155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1a909-444e-49e3-93ce-3e0142c46c32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:53.575763 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1a909-444e-49e3-93ce-3e0142c46c32 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:53.585732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1210/2398] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:06:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 23:06:53.613327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563483-5d68-4113-be44-5579339b2ef7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:53.620177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:53.620177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:53.620177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:53.620444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] PATH_INFO: `/v3/users/229fe50ba663455686db9df3805f8f1f` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:53.621628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=229fe50ba663455686db9df3805f8f1f)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:53.623602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:53.849880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229fe50ba663455686db9df3805f8f1f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:53.851047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229fe50ba663455686db9df3805f8f1f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:53.941719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229fe50ba663455686db9df3805f8f1f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:53.943591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:53.956373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229fe50ba663455686db9df3805f8f1f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:53.964925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229fe50ba663455686db9df3805f8f1f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:53.972375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1189/2399] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:06:53 2022] DELETE /identity/v3/users/229fe50ba663455686db9df3805f8f1f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:06:54.656552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1a909-444e-49e3-93ce-3e0142c46c32 service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:54.661862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1a909-444e-49e3-93ce-3e0142c46c32 service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:54.685974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:54.768574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:54.769294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:54.769615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:54.769947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] PATH_INFO: `/v3/projects/6c0a45f2f5184597aa55520f2d86f307` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:54.771906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c0a45f2f5184597aa55520f2d86f307)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:54.776342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:54.908828 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c0a45f2f5184597aa55520f2d86f307', 'request_id': 'req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:54.922831 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c0a45f2f5184597aa55520f2d86f307', 'request_id': 'req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:54.933897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c0a45f2f5184597aa55520f2d86f307', 'request_id': 'req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:55.013551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] The token cache is being invalidate because project 6c0a45f2f5184597aa55520f2d86f307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:55.013969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:55.014804 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:55.016712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1211/2400] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:54 2022] DELETE /identity/v3/projects/6c0a45f2f5184597aa55520f2d86f307 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:06:55.021944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:55.024681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:55.048196 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5c78e-6f3e-4a86-8c14-268ea3c09e3f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:55.122817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:55.123627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:55.125338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:55.125941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] PATH_INFO: `/v3/users/d1fe3dd197984dc09b8c1892f4b8439f` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:55.127512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1fe3dd197984dc09b8c1892f4b8439f)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:55.129616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:55.570970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1fe3dd197984dc09b8c1892f4b8439f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:55.571662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1fe3dd197984dc09b8c1892f4b8439f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:55.670142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1fe3dd197984dc09b8c1892f4b8439f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:55.698787 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1fe3dd197984dc09b8c1892f4b8439f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:55.713073 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1fe3dd197984dc09b8c1892f4b8439f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:55.720615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1190/2401] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:06:55 2022] DELETE /identity/v3/users/d1fe3dd197984dc09b8c1892f4b8439f => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:06:56.345983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:56.345983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:56.359600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f480-a1ac-4fbe-9fa2-6583bc87224b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:56.431318 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:56.432092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:56.432440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:56.432728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] PATH_INFO: `/v3/projects/b35c7ebc857843aea4bfbfc11fb7b4d0` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:56.433955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35c7ebc857843aea4bfbfc11fb7b4d0)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:56.435926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:56.607392 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35c7ebc857843aea4bfbfc11fb7b4d0', 'request_id': 'req-9e66be0a-67a5-4065-8bd8-4056c7e250ed'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:56.615543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35c7ebc857843aea4bfbfc11fb7b4d0', 'request_id': 'req-9e66be0a-67a5-4065-8bd8-4056c7e250ed'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:56.617843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:56.625110 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35c7ebc857843aea4bfbfc11fb7b4d0', 'request_id': 'req-9e66be0a-67a5-4065-8bd8-4056c7e250ed'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:56.752125 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] The token cache is being invalidate because project b35c7ebc857843aea4bfbfc11fb7b4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:06:56.752903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:56.753866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:06:56.755453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1212/2402] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:06:56 2022] DELETE /identity/v3/projects/b35c7ebc857843aea4bfbfc11fb7b4d0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:07:05.716552 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:06.698730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:06.700265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:06.774419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a3a15-9fb3-44d7-9b50-efa4197e78df admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:06.836905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb07499-abcd-4db4-bbcb-25283b522004 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:06.837538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07499-abcd-4db4-bbcb-25283b522004 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:06.837824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07499-abcd-4db4-bbcb-25283b522004 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:06.838097 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07499-abcd-4db4-bbcb-25283b522004 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:06.839979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4fb07499-abcd-4db4-bbcb-25283b522004 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:06.853521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb07499-abcd-4db4-bbcb-25283b522004 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:06.855144 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb07499-abcd-4db4-bbcb-25283b522004 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:06.866079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1191/2403] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:07:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:07:06.915944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=3,keystone:SELECT=4,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:16.861178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=58 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:23.280931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:23.282497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:23.356000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66be0a-67a5-4065-8bd8-4056c7e250ed admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:23.360736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:23.361417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:23.361696 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:23.361974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] PATH_INFO: `/v3/users/73522376e8264fa3b417b50a780f1376` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:23.363149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73522376e8264fa3b417b50a780f1376)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:23.365187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:23.661955 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73522376e8264fa3b417b50a780f1376'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:07:23.668928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73522376e8264fa3b417b50a780f1376'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:07:23.743985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73522376e8264fa3b417b50a780f1376'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:07:23.744602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73522376e8264fa3b417b50a780f1376'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:07:23.745244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73522376e8264fa3b417b50a780f1376'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:07:23.763714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1213/2404] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:07:23 2022] DELETE /identity/v3/users/73522376e8264fa3b417b50a780f1376 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:07:23.768239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a114f-7700-43ab-bd79-3ff08956bfb9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:23.768747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a114f-7700-43ab-bd79-3ff08956bfb9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:23.768845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a114f-7700-43ab-bd79-3ff08956bfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:23.787729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-292a114f-7700-43ab-bd79-3ff08956bfb9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:07:23.788928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-292a114f-7700-43ab-bd79-3ff08956bfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:23.847326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1192/2405] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:07:23.857342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:23.858780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:23.916135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f5da-1531-4f3b-becb-bc1793ef9af4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:23.925089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df45301-e108-42bc-8668-511df5e825d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:23.925780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45301-e108-42bc-8668-511df5e825d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:23.926062 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45301-e108-42bc-8668-511df5e825d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:23.926337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45301-e108-42bc-8668-511df5e825d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:23.936944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df45301-e108-42bc-8668-511df5e825d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:23.938607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df45301-e108-42bc-8668-511df5e825d1 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:23.948966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1214/2406] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:07:24.379971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a114f-7700-43ab-bd79-3ff08956bfb9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:24.381517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-292a114f-7700-43ab-bd79-3ff08956bfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:24.394318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a114f-7700-43ab-bd79-3ff08956bfb9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:24.399971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:24.400629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:24.400913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:24.401227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] PATH_INFO: `/v3/projects/312ec150f9db41ed95d18b90cdd3ca6e` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:24.402415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=312ec150f9db41ed95d18b90cdd3ca6e)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:24.404442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:24.528120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312ec150f9db41ed95d18b90cdd3ca6e', 'request_id': 'req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:07:24.534570 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312ec150f9db41ed95d18b90cdd3ca6e', 'request_id': 'req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:07:24.583691 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312ec150f9db41ed95d18b90cdd3ca6e', 'request_id': 'req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:07:24.595335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] The token cache is being invalidate because project 312ec150f9db41ed95d18b90cdd3ca6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:07:24.595628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:07:24.596272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2db7bc4e-f1b6-4f3f-8808-0c5f1663ff76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:07:24.597831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1193/2407] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:07:24 2022] DELETE /identity/v3/projects/312ec150f9db41ed95d18b90cdd3ca6e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:07:24.603471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f98b4a-e1a6-454d-9a6e-9622c2576458 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:24.603835 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f98b4a-e1a6-454d-9a6e-9622c2576458 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:24.604042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f98b4a-e1a6-454d-9a6e-9622c2576458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:24.624408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-88f98b4a-e1a6-454d-9a6e-9622c2576458 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:07:24.625612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-88f98b4a-e1a6-454d-9a6e-9622c2576458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:24.642714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:24.691794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1215/2408] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:07:24.699745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9291a7-16cf-4179-9cd6-057bf68b73a2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:24.700032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9291a7-16cf-4179-9cd6-057bf68b73a2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:24.700334 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9291a7-16cf-4179-9cd6-057bf68b73a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:24.723324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9e9291a7-16cf-4179-9cd6-057bf68b73a2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:07:24.724550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9e9291a7-16cf-4179-9cd6-057bf68b73a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:24.733577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1194/2409] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:07:24.737893 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f98b4a-e1a6-454d-9a6e-9622c2576458 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:24.748367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f98b4a-e1a6-454d-9a6e-9622c2576458 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:24.753271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363398-714b-4afa-a783-b505a3e83b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:24.753891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363398-714b-4afa-a783-b505a3e83b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:24.754174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363398-714b-4afa-a783-b505a3e83b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:24.754452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363398-714b-4afa-a783-b505a3e83b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:24.755153 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33363398-714b-4afa-a783-b505a3e83b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:07:24.755460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33363398-714b-4afa-a783-b505a3e83b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:24.757076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33363398-714b-4afa-a783-b505a3e83b52 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:24.769325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1216/2410] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:07:24.773981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9291a7-16cf-4179-9cd6-057bf68b73a2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:24.783877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9291a7-16cf-4179-9cd6-057bf68b73a2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:24.789587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089ea0e-8378-4022-9a11-ff6f56910611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:24.790280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089ea0e-8378-4022-9a11-ff6f56910611 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:24.790563 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089ea0e-8378-4022-9a11-ff6f56910611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:24.790837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089ea0e-8378-4022-9a11-ff6f56910611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:24.791874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089ea0e-8378-4022-9a11-ff6f56910611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:24.793847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089ea0e-8378-4022-9a11-ff6f56910611 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:24.874137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1195/2411] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:07:24 2022] POST /identity/v3/projects => generated 359 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:07:24.889530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363398-714b-4afa-a783-b505a3e83b52 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:24.889530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363398-714b-4afa-a783-b505a3e83b52 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:24.942662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98690e-0df0-43a9-8276-84cedc6ba169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:24.943285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98690e-0df0-43a9-8276-84cedc6ba169 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:24.943573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98690e-0df0-43a9-8276-84cedc6ba169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:24.943849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98690e-0df0-43a9-8276-84cedc6ba169 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:24.944550 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98690e-0df0-43a9-8276-84cedc6ba169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:24.947010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98690e-0df0-43a9-8276-84cedc6ba169 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:25.056123 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1217/2412] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:07:24 2022] POST /identity/v3/users => generated 280 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:07:25.057444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089ea0e-8378-4022-9a11-ff6f56910611 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:25.071638 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089ea0e-8378-4022-9a11-ff6f56910611 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:25.076543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60910ae-0a1f-4950-9465-c0452ff2f12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:25.077186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60910ae-0a1f-4950-9465-c0452ff2f12f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:25.077471 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60910ae-0a1f-4950-9465-c0452ff2f12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:25.077773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60910ae-0a1f-4950-9465-c0452ff2f12f admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:25.078464 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60910ae-0a1f-4950-9465-c0452ff2f12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:25.080072 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60910ae-0a1f-4950-9465-c0452ff2f12f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:25.091641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1196/2413] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:07:25.095418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98690e-0df0-43a9-8276-84cedc6ba169 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:25.105863 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98690e-0df0-43a9-8276-84cedc6ba169 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:25.110570 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831da2c-97d6-44e7-8fdb-573919368f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:25.111174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831da2c-97d6-44e7-8fdb-573919368f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:25.111452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831da2c-97d6-44e7-8fdb-573919368f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:25.111725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831da2c-97d6-44e7-8fdb-573919368f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:25.112407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831da2c-97d6-44e7-8fdb-573919368f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:25.114162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831da2c-97d6-44e7-8fdb-573919368f01 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:25.125165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1218/2414] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:07:25.129319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60910ae-0a1f-4950-9465-c0452ff2f12f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:25.140127 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60910ae-0a1f-4950-9465-c0452ff2f12f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:25.144688 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd89413-cc12-4fe6-a970-d6c5a23f7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:25.145381 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd89413-cc12-4fe6-a970-d6c5a23f7403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:25.145664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd89413-cc12-4fe6-a970-d6c5a23f7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:25.145939 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd89413-cc12-4fe6-a970-d6c5a23f7403 admin admin] PATH_INFO: `/v3/projects/9e93c3d5644b44038f3f3c85d0dbbc8b/users/d4d5430ad7ba446990bd3438de922f03/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:25.162999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd89413-cc12-4fe6-a970-d6c5a23f7403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e93c3d5644b44038f3f3c85d0dbbc8b, user_id=d4d5430ad7ba446990bd3438de922f03, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:25.166415 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd89413-cc12-4fe6-a970-d6c5a23f7403 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:25.247319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1197/2415] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:07:25 2022] PUT /identity/v3/projects/9e93c3d5644b44038f3f3c85d0dbbc8b/users/d4d5430ad7ba446990bd3438de922f03/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:07:25.259829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6514f-999c-4523-903c-da195e9d5be8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:25.260113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6514f-999c-4523-903c-da195e9d5be8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:25.260410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6514f-999c-4523-903c-da195e9d5be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:25.287847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e4f6514f-999c-4523-903c-da195e9d5be8 None None] MFA Rules not processed for user `d4d5430ad7ba446990bd3438de922f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:07:25.289087 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e4f6514f-999c-4523-903c-da195e9d5be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:25.353908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1219/2416] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:07:25 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:07:25.364969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd89413-cc12-4fe6-a970-d6c5a23f7403 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:25.366677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-acd89413-cc12-4fe6-a970-d6c5a23f7403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:25.390090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:25.425585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd89413-cc12-4fe6-a970-d6c5a23f7403 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:25.430526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a71cb-4052-45c4-83a9-ec4a10af9e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:25.431099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a71cb-4052-45c4-83a9-ec4a10af9e3e service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:25.431379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a71cb-4052-45c4-83a9-ec4a10af9e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:25.431679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a71cb-4052-45c4-83a9-ec4a10af9e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:25.440274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a71cb-4052-45c4-83a9-ec4a10af9e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:25.441781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a71cb-4052-45c4-83a9-ec4a10af9e3e service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:25.451697 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1198/2417] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:07:25 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:07:35.350660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:35.480064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=17 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:40.880668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf52c1-6224-4e8c-9245-4804d716c9a7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:40.881177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf52c1-6224-4e8c-9245-4804d716c9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:40.881292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf52c1-6224-4e8c-9245-4804d716c9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:40.904630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-febf52c1-6224-4e8c-9245-4804d716c9a7 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:07:40.905956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-febf52c1-6224-4e8c-9245-4804d716c9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:40.963518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1220/2418] 10.222.0.55 () {58 vars in 967 bytes} [Mon Jul 25 23:07:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:07:40.986183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a71cb-4052-45c4-83a9-ec4a10af9e3e service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:07:40.987704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1c5a71cb-4052-45c4-83a9-ec4a10af9e3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:07:41.061060 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a71cb-4052-45c4-83a9-ec4a10af9e3e service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:07:41.066455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba32c7-abb6-433f-9068-77c959814d06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:07:41.067075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba32c7-abb6-433f-9068-77c959814d06 service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:07:41.067352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba32c7-abb6-433f-9068-77c959814d06 service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:07:41.067624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba32c7-abb6-433f-9068-77c959814d06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:07:41.076831 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba32c7-abb6-433f-9068-77c959814d06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:07:41.078444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba32c7-abb6-433f-9068-77c959814d06 service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:07:41.086525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1199/2419] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:07:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:07:50.956487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=25 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:51.083268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=32 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:15.626094 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0491ee9-8624-4321-a5eb-d320d545ff5e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:15.632209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0491ee9-8624-4321-a5eb-d320d545ff5e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:15.632209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0491ee9-8624-4321-a5eb-d320d545ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:15.652801 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e0491ee9-8624-4321-a5eb-d320d545ff5e None None] MFA Rules not processed for user `ec45d64732fe4aac9fe6b9d6cd04a6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:15.654068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e0491ee9-8624-4321-a5eb-d320d545ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:15.722430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1221/2420] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:08:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:08:16.335993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba32c7-abb6-433f-9068-77c959814d06 service swift] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:16.411928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba32c7-abb6-433f-9068-77c959814d06 service swift] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:16.417057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:16.417938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:16.418437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:16.418748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] PATH_INFO: `/v3/users/d4d5430ad7ba446990bd3438de922f03` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:16.420106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d5430ad7ba446990bd3438de922f03)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:16.422067 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:16.646442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d5430ad7ba446990bd3438de922f03'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:16.647193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d5430ad7ba446990bd3438de922f03'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:16.724580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d5430ad7ba446990bd3438de922f03'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:16.739459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d5430ad7ba446990bd3438de922f03'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:16.746959 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d5430ad7ba446990bd3438de922f03'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:16.754458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1200/2421] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:08:16 2022] DELETE /identity/v3/users/d4d5430ad7ba446990bd3438de922f03 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:16.759328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99bf3-6a00-43c3-ad0c-7ea462c206b4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:16.759714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99bf3-6a00-43c3-ad0c-7ea462c206b4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:16.759980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99bf3-6a00-43c3-ad0c-7ea462c206b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:16.780209 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e5f99bf3-6a00-43c3-ad0c-7ea462c206b4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:16.781446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e5f99bf3-6a00-43c3-ad0c-7ea462c206b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:16.843090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1222/2422] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:08:16.853552 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:16.855023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:16.916235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7258b1e-cd3b-4f73-8fc8-63bbce50f1f8 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:16.920337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b5ea5-725e-4e9f-8a14-280d17091ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:16.920967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b5ea5-725e-4e9f-8a14-280d17091ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:16.921273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b5ea5-725e-4e9f-8a14-280d17091ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:16.921546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b5ea5-725e-4e9f-8a14-280d17091ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:16.932545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b5ea5-725e-4e9f-8a14-280d17091ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:16.934016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b5ea5-725e-4e9f-8a14-280d17091ca2 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:16.943992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1201/2423] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:08:17.352477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99bf3-6a00-43c3-ad0c-7ea462c206b4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:17.352987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e5f99bf3-6a00-43c3-ad0c-7ea462c206b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:17.366072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99bf3-6a00-43c3-ad0c-7ea462c206b4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:17.371372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:17.372141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:17.372536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:17.372907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] PATH_INFO: `/v3/projects/9e93c3d5644b44038f3f3c85d0dbbc8b` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:17.374225 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e93c3d5644b44038f3f3c85d0dbbc8b)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:17.387234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:17.492531 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e93c3d5644b44038f3f3c85d0dbbc8b', 'request_id': 'req-0473ca0b-faf6-4b78-8853-fb6244aaef2f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:17.498722 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e93c3d5644b44038f3f3c85d0dbbc8b', 'request_id': 'req-0473ca0b-faf6-4b78-8853-fb6244aaef2f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:17.504770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e93c3d5644b44038f3f3c85d0dbbc8b', 'request_id': 'req-0473ca0b-faf6-4b78-8853-fb6244aaef2f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:17.559664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] The token cache is being invalidate because project 9e93c3d5644b44038f3f3c85d0dbbc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:08:17.559957 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:17.560578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0473ca0b-faf6-4b78-8853-fb6244aaef2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:17.562141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1223/2424] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:08:17 2022] DELETE /identity/v3/projects/9e93c3d5644b44038f3f3c85d0dbbc8b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:17.568669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc56130-04b5-407c-9870-5991b794cded None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:17.569596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc56130-04b5-407c-9870-5991b794cded None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:17.569892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc56130-04b5-407c-9870-5991b794cded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:17.591318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ecc56130-04b5-407c-9870-5991b794cded None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:17.592882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ecc56130-04b5-407c-9870-5991b794cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:17.610478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:17.656742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1202/2425] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:08:17.664896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c941c-148b-458e-9eb8-9980f30287f1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:17.665237 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c941c-148b-458e-9eb8-9980f30287f1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:17.665515 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c941c-148b-458e-9eb8-9980f30287f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:17.687370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-116c941c-148b-458e-9eb8-9980f30287f1 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:17.689206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-116c941c-148b-458e-9eb8-9980f30287f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:17.698890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1224/2426] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:08:17.707287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc56130-04b5-407c-9870-5991b794cded None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:17.722810 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc56130-04b5-407c-9870-5991b794cded None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:17.723539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b43c2-0d59-42ac-9499-5261cb0b981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:17.724270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b43c2-0d59-42ac-9499-5261cb0b981c admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:17.724449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b43c2-0d59-42ac-9499-5261cb0b981c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:17.724726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b43c2-0d59-42ac-9499-5261cb0b981c admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:17.725450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b43c2-0d59-42ac-9499-5261cb0b981c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:08:17.725753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b43c2-0d59-42ac-9499-5261cb0b981c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:17.727354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b43c2-0d59-42ac-9499-5261cb0b981c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:17.739314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1203/2427] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:08:17.743964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c941c-148b-458e-9eb8-9980f30287f1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:17.754224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c941c-148b-458e-9eb8-9980f30287f1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:17.758905 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e929ce-6df8-4279-9456-3ea84155fa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:17.759518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e929ce-6df8-4279-9456-3ea84155fa99 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:17.760075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e929ce-6df8-4279-9456-3ea84155fa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:17.760075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e929ce-6df8-4279-9456-3ea84155fa99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:17.760725 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e929ce-6df8-4279-9456-3ea84155fa99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:17.762680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e929ce-6df8-4279-9456-3ea84155fa99 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:17.875021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:17.882273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1225/2428] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:08:17 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:08:17.886512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b43c2-0d59-42ac-9499-5261cb0b981c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:17.897104 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b43c2-0d59-42ac-9499-5261cb0b981c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:17.955912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c6b81-a71c-4287-9b9f-20fc2371d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:17.957744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c6b81-a71c-4287-9b9f-20fc2371d18a admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:17.957744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c6b81-a71c-4287-9b9f-20fc2371d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:17.957744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c6b81-a71c-4287-9b9f-20fc2371d18a admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:17.957744 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c6b81-a71c-4287-9b9f-20fc2371d18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:17.959674 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c6b81-a71c-4287-9b9f-20fc2371d18a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:18.052517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1204/2429] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:08:17 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:08:18.056478 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e929ce-6df8-4279-9456-3ea84155fa99 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:18.068210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e929ce-6df8-4279-9456-3ea84155fa99 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:18.073344 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a1db-2a79-4d43-b108-81ab85bf5d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:18.074173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a1db-2a79-4d43-b108-81ab85bf5d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:18.074449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a1db-2a79-4d43-b108-81ab85bf5d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:18.074719 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a1db-2a79-4d43-b108-81ab85bf5d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:18.075421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a1db-2a79-4d43-b108-81ab85bf5d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:18.077061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a1db-2a79-4d43-b108-81ab85bf5d45 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:18.090061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1226/2430] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:08:18.094450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c6b81-a71c-4287-9b9f-20fc2371d18a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:18.104698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c6b81-a71c-4287-9b9f-20fc2371d18a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:18.109538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b53e40-cdb1-4456-9a65-a38deba26741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:18.110153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b53e40-cdb1-4456-9a65-a38deba26741 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:18.110440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b53e40-cdb1-4456-9a65-a38deba26741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:18.110714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b53e40-cdb1-4456-9a65-a38deba26741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:18.112089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b53e40-cdb1-4456-9a65-a38deba26741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:18.113867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b53e40-cdb1-4456-9a65-a38deba26741 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:18.125174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1205/2431] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:08:18.130218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a1db-2a79-4d43-b108-81ab85bf5d45 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:18.140203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a1db-2a79-4d43-b108-81ab85bf5d45 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:18.144809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa4a8-3e87-4392-bcdb-f9bde57ac38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:18.145502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa4a8-3e87-4392-bcdb-f9bde57ac38f admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:18.145787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa4a8-3e87-4392-bcdb-f9bde57ac38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:18.146065 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa4a8-3e87-4392-bcdb-f9bde57ac38f admin admin] PATH_INFO: `/v3/projects/6b50573ab0f24bedb817d86519814a89/users/bef70fe50e894425a97780826e38db50/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:18.161846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfa4a8-3e87-4392-bcdb-f9bde57ac38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b50573ab0f24bedb817d86519814a89, user_id=bef70fe50e894425a97780826e38db50, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:18.164562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfa4a8-3e87-4392-bcdb-f9bde57ac38f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:18.280661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1227/2432] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:08:18 2022] PUT /identity/v3/projects/6b50573ab0f24bedb817d86519814a89/users/bef70fe50e894425a97780826e38db50/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:18.292354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926650-c5a7-4e9a-885e-8f98d970f56a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:18.292639 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926650-c5a7-4e9a-885e-8f98d970f56a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:18.292914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926650-c5a7-4e9a-885e-8f98d970f56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:18.321527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-72926650-c5a7-4e9a-885e-8f98d970f56a None None] MFA Rules not processed for user `bef70fe50e894425a97780826e38db50`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:18.322665 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-72926650-c5a7-4e9a-885e-8f98d970f56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:18.388465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1206/2433] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:08:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:08:18.400149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa4a8-3e87-4392-bcdb-f9bde57ac38f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:18.401867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d0bfa4a8-3e87-4392-bcdb-f9bde57ac38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:18.464844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa4a8-3e87-4392-bcdb-f9bde57ac38f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:18.469473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68b71d-bcd8-4b3d-9bd1-d9aa4cfc5c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:18.470082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68b71d-bcd8-4b3d-9bd1-d9aa4cfc5c06 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:18.470360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68b71d-bcd8-4b3d-9bd1-d9aa4cfc5c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:18.471191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68b71d-bcd8-4b3d-9bd1-d9aa4cfc5c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:18.481265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68b71d-bcd8-4b3d-9bd1-d9aa4cfc5c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:18.482731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68b71d-bcd8-4b3d-9bd1-d9aa4cfc5c06 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:18.493414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1228/2434] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:08:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:08:18.519538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926650-c5a7-4e9a-885e-8f98d970f56a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:18.540438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:18.584717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926650-c5a7-4e9a-885e-8f98d970f56a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:18.589239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:18.589881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:18.591618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:18.591618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] PATH_INFO: `/v3/users/bef70fe50e894425a97780826e38db50` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:18.591618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef70fe50e894425a97780826e38db50)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:18.593543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:18.801033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef70fe50e894425a97780826e38db50'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:18.801742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef70fe50e894425a97780826e38db50'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:18.920218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef70fe50e894425a97780826e38db50'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:18.933925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef70fe50e894425a97780826e38db50'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:18.941874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef70fe50e894425a97780826e38db50'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:18.948016 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1207/2435] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:08:18 2022] DELETE /identity/v3/users/bef70fe50e894425a97780826e38db50 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:18.952393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000dfde-29e9-4b84-a938-d0acf3d54319 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:18.954648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000dfde-29e9-4b84-a938-d0acf3d54319 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:18.954648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000dfde-29e9-4b84-a938-d0acf3d54319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:18.972391 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2000dfde-29e9-4b84-a938-d0acf3d54319 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:18.973648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2000dfde-29e9-4b84-a938-d0acf3d54319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:19.032693 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1229/2436] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:08:19.042681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:19.044380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:19.112311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dc324-e248-4ebd-ae34-d5397a3942cf admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:19.117759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1bad-a5dd-4876-ae04-e726caa4ab4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:19.118397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1bad-a5dd-4876-ae04-e726caa4ab4e service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:19.118766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1bad-a5dd-4876-ae04-e726caa4ab4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:19.119005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1bad-a5dd-4876-ae04-e726caa4ab4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:19.130172 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1bad-a5dd-4876-ae04-e726caa4ab4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:19.131644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1bad-a5dd-4876-ae04-e726caa4ab4e service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:19.141729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1208/2437] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:08:19.558076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000dfde-29e9-4b84-a938-d0acf3d54319 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:19.558369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2000dfde-29e9-4b84-a938-d0acf3d54319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:19.582080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000dfde-29e9-4b84-a938-d0acf3d54319 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:19.592694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:19.592694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:19.592694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:19.592694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] PATH_INFO: `/v3/projects/6b50573ab0f24bedb817d86519814a89` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:19.593471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b50573ab0f24bedb817d86519814a89)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:19.593471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:19.739589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b50573ab0f24bedb817d86519814a89', 'request_id': 'req-c425eb1b-6af4-4666-82ae-78823abbcf1e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:19.747199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b50573ab0f24bedb817d86519814a89', 'request_id': 'req-c425eb1b-6af4-4666-82ae-78823abbcf1e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:19.755482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b50573ab0f24bedb817d86519814a89', 'request_id': 'req-c425eb1b-6af4-4666-82ae-78823abbcf1e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:19.757157 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:19.823106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] The token cache is being invalidate because project 6b50573ab0f24bedb817d86519814a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:08:19.823393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:19.824010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c425eb1b-6af4-4666-82ae-78823abbcf1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:19.825576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1230/2438] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:08:19 2022] DELETE /identity/v3/projects/6b50573ab0f24bedb817d86519814a89 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:22.670580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d2d9-fbe9-4bc9-8c41-fc7fd720e58d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:22.671069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d2d9-fbe9-4bc9-8c41-fc7fd720e58d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:22.671177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d2d9-fbe9-4bc9-8c41-fc7fd720e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:22.690794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7036d2d9-fbe9-4bc9-8c41-fc7fd720e58d None None] MFA Rules not processed for user `61d3b5a3082a4c74a2a08007581388c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:22.692718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7036d2d9-fbe9-4bc9-8c41-fc7fd720e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:22.728018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:22.749560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1209/2439] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:08:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:08:30.136754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:32.823162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:41.155603 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936024b7-1ba7-44ff-b7a2-422e85866d3c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:41.156131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936024b7-1ba7-44ff-b7a2-422e85866d3c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:41.156131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936024b7-1ba7-44ff-b7a2-422e85866d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:41.175720 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-936024b7-1ba7-44ff-b7a2-422e85866d3c None None] MFA Rules not processed for user `fbc4fc1f207c4726b9c05b6b338f0e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:41.177008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-936024b7-1ba7-44ff-b7a2-422e85866d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:41.234276 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1231/2440] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:08:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:08:41.606822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bad00-e5e1-44f0-a3ae-8430f156a720 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:41.611379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bad00-e5e1-44f0-a3ae-8430f156a720 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:41.611379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bad00-e5e1-44f0-a3ae-8430f156a720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:41.629408 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-867bad00-e5e1-44f0-a3ae-8430f156a720 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:41.633071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-867bad00-e5e1-44f0-a3ae-8430f156a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:41.698499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1210/2441] 10.222.0.55 () {58 vars in 967 bytes} [Mon Jul 25 23:08:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:08:41.901890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936024b7-1ba7-44ff-b7a2-422e85866d3c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:41.903329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-936024b7-1ba7-44ff-b7a2-422e85866d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:41.999982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936024b7-1ba7-44ff-b7a2-422e85866d3c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:42.008075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307c12c-3ce2-4ec4-b09c-dd2e55a4bc7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:42.008720 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307c12c-3ce2-4ec4-b09c-dd2e55a4bc7f service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:42.009002 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307c12c-3ce2-4ec4-b09c-dd2e55a4bc7f service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:42.009313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307c12c-3ce2-4ec4-b09c-dd2e55a4bc7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:42.019810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307c12c-3ce2-4ec4-b09c-dd2e55a4bc7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:42.021824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307c12c-3ce2-4ec4-b09c-dd2e55a4bc7f service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:42.032853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1232/2442] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:08:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 23:08:51.169137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bad00-e5e1-44f0-a3ae-8430f156a720 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:51.170803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-867bad00-e5e1-44f0-a3ae-8430f156a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:51.256633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bad00-e5e1-44f0-a3ae-8430f156a720 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:51.263541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1886465-ff45-4f79-ade6-a06dd708f062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:51.265315 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1886465-ff45-4f79-ade6-a06dd708f062 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:51.265757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1886465-ff45-4f79-ade6-a06dd708f062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:51.266201 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1886465-ff45-4f79-ade6-a06dd708f062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:51.268576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e1886465-ff45-4f79-ade6-a06dd708f062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:51.401385 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1886465-ff45-4f79-ade6-a06dd708f062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:51.402931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1886465-ff45-4f79-ade6-a06dd708f062 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:51.426865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1211/2443] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:08:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:08:51.527915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307c12c-3ce2-4ec4-b09c-dd2e55a4bc7f service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:51.541497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307c12c-3ce2-4ec4-b09c-dd2e55a4bc7f service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:51.545632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892468e-337c-41fe-9f67-dfd7e10de6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:51.546250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892468e-337c-41fe-9f67-dfd7e10de6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:51.546531 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892468e-337c-41fe-9f67-dfd7e10de6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:51.546805 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892468e-337c-41fe-9f67-dfd7e10de6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:51.548836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7892468e-337c-41fe-9f67-dfd7e10de6a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:51.563883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892468e-337c-41fe-9f67-dfd7e10de6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:51.565554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892468e-337c-41fe-9f67-dfd7e10de6a6 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:51.577741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1233/2444] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:08:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:08:52.069865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1886465-ff45-4f79-ade6-a06dd708f062 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:52.070539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e1886465-ff45-4f79-ade6-a06dd708f062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:52.121929 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:52.139006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1886465-ff45-4f79-ade6-a06dd708f062 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:52.144353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:52.145041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:52.145375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:52.145655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] PATH_INFO: `/v3/users/2c4c72b9c83a4967b57b6633f9934dd4` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:52.146870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4c72b9c83a4967b57b6633f9934dd4)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:52.149205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:52.367371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4c72b9c83a4967b57b6633f9934dd4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:52.368032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4c72b9c83a4967b57b6633f9934dd4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:52.428399 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4c72b9c83a4967b57b6633f9934dd4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:52.441588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4c72b9c83a4967b57b6633f9934dd4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:52.456328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4c72b9c83a4967b57b6633f9934dd4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:52.456328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1212/2445] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:08:52 2022] DELETE /identity/v3/users/2c4c72b9c83a4967b57b6633f9934dd4 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:52.762925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892468e-337c-41fe-9f67-dfd7e10de6a6 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:52.774672 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892468e-337c-41fe-9f67-dfd7e10de6a6 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:52.853571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:52.854250 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:52.854536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:52.854812 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] PATH_INFO: `/v3/projects/d0af93f7c6b54114b0e1b5c32e3bf623` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:52.856714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0af93f7c6b54114b0e1b5c32e3bf623)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:52.858858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:52.886951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:52.977313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'request_id': 'req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:52.984177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'request_id': 'req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:52.990472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'request_id': 'req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:53.060403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] The token cache is being invalidate because project d0af93f7c6b54114b0e1b5c32e3bf623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:08:53.060403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:53.060403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:53.060403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1234/2446] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:08:52 2022] DELETE /identity/v3/projects/d0af93f7c6b54114b0e1b5c32e3bf623 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:53.063035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:53.064589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:53.078618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0e489-9867-4bda-a138-eb25777223f0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:53.136899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:53.137633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:53.137865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:53.138143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] PATH_INFO: `/v3/users/9c9f53322fe84793b65cdbe8eb8de041` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:53.139333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9f53322fe84793b65cdbe8eb8de041)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:53.141373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:53.358926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9f53322fe84793b65cdbe8eb8de041'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:53.359681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9f53322fe84793b65cdbe8eb8de041'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:53.468456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9f53322fe84793b65cdbe8eb8de041'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:53.480640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:53.483666 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9f53322fe84793b65cdbe8eb8de041'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:53.490711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-74b0cc1e-0908-45e8-88f7-5a50be3f4d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9f53322fe84793b65cdbe8eb8de041'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:53.496815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1213/2447] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:08:53 2022] DELETE /identity/v3/users/9c9f53322fe84793b65cdbe8eb8de041 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:53.852127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:53.862630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:53.879010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa07c9-8d93-4c2b-b8e7-d66bf4cc2d82 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:53.983211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:53.988569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:53.988569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:53.988569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] PATH_INFO: `/v3/projects/b7234eb5e7404b15bd8b6470ecb23504` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:53.988569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7234eb5e7404b15bd8b6470ecb23504)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:53.988569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:54.098445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7234eb5e7404b15bd8b6470ecb23504', 'request_id': 'req-b0244db2-05f0-4df8-9892-9e32dcb77927'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:54.104819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7234eb5e7404b15bd8b6470ecb23504', 'request_id': 'req-b0244db2-05f0-4df8-9892-9e32dcb77927'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:54.111493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7234eb5e7404b15bd8b6470ecb23504', 'request_id': 'req-b0244db2-05f0-4df8-9892-9e32dcb77927'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:54.188875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] The token cache is being invalidate because project b7234eb5e7404b15bd8b6470ecb23504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:08:54.189531 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:54.190407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:54.192282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1235/2448] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:08:53 2022] DELETE /identity/v3/projects/b7234eb5e7404b15bd8b6470ecb23504 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:59.762891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b59954-8992-4601-862e-04b30d5f1ca2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:59.763396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b59954-8992-4601-862e-04b30d5f1ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:59.763587 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b59954-8992-4601-862e-04b30d5f1ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:59.785418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-30b59954-8992-4601-862e-04b30d5f1ca2 None None] MFA Rules not processed for user `4eea5a29c87d431299b220e404fd5732`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:59.786623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-30b59954-8992-4601-862e-04b30d5f1ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:59.843566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1214/2449] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:08:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:09:04.184794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:08.335045 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:08.336327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:08.417472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0244db2-05f0-4df8-9892-9e32dcb77927 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:08.423508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd847c59-460c-4981-b975-3b6308cc0f3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:08.424270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd847c59-460c-4981-b975-3b6308cc0f3f service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:08.424524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd847c59-460c-4981-b975-3b6308cc0f3f service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:08.424800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd847c59-460c-4981-b975-3b6308cc0f3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:08.427501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bd847c59-460c-4981-b975-3b6308cc0f3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:08.438355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd847c59-460c-4981-b975-3b6308cc0f3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:08.440401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd847c59-460c-4981-b975-3b6308cc0f3f service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:08.449912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1236/2450] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:09:09.836968 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=1,keystone:SELECT=31 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:10.414739 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b59954-8992-4601-862e-04b30d5f1ca2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:10.416203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-30b59954-8992-4601-862e-04b30d5f1ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:10.473378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b59954-8992-4601-862e-04b30d5f1ca2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:10.476964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7409af-748d-4349-acd2-195f1ca29a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:10.477608 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7409af-748d-4349-acd2-195f1ca29a00 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:10.477896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7409af-748d-4349-acd2-195f1ca29a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:10.478210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7409af-748d-4349-acd2-195f1ca29a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:10.479980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7d7409af-748d-4349-acd2-195f1ca29a00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:10.537990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7409af-748d-4349-acd2-195f1ca29a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:10.539436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7409af-748d-4349-acd2-195f1ca29a00 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:10.553932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1215/2451] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:09:18.445504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=34 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:19.190952 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd847c59-460c-4981-b975-3b6308cc0f3f service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:19.192382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bd847c59-460c-4981-b975-3b6308cc0f3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:19.250455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd847c59-460c-4981-b975-3b6308cc0f3f service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:19.254040 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76971d-20f7-4f7e-99a1-c8c6b9348f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:19.254688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76971d-20f7-4f7e-99a1-c8c6b9348f66 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:19.255000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76971d-20f7-4f7e-99a1-c8c6b9348f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:19.255369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76971d-20f7-4f7e-99a1-c8c6b9348f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:19.257154 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-da76971d-20f7-4f7e-99a1-c8c6b9348f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:19.267306 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76971d-20f7-4f7e-99a1-c8c6b9348f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:19.268759 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76971d-20f7-4f7e-99a1-c8c6b9348f66 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:19.278314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1237/2452] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:09:20.544199 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=48 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:29.274472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=26 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:30.136613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7409af-748d-4349-acd2-195f1ca29a00 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:30.150782 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7409af-748d-4349-acd2-195f1ca29a00 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:30.156542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bff1d-8e8d-42cf-84b3-bdd350dbea09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:30.157191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bff1d-8e8d-42cf-84b3-bdd350dbea09 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:30.157479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bff1d-8e8d-42cf-84b3-bdd350dbea09 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:30.157760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bff1d-8e8d-42cf-84b3-bdd350dbea09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:30.159543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-397bff1d-8e8d-42cf-84b3-bdd350dbea09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:30.172391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bff1d-8e8d-42cf-84b3-bdd350dbea09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:30.174100 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bff1d-8e8d-42cf-84b3-bdd350dbea09 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:30.185636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1216/2453] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:09:31.372087 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76971d-20f7-4f7e-99a1-c8c6b9348f66 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:31.373624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-da76971d-20f7-4f7e-99a1-c8c6b9348f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:31.441405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76971d-20f7-4f7e-99a1-c8c6b9348f66 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:31.446486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:31.447130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:31.447412 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:31.447738 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] PATH_INFO: `/v3/users/ec45d64732fe4aac9fe6b9d6cd04a6f4` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:31.448981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec45d64732fe4aac9fe6b9d6cd04a6f4)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:31.451010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:31.618089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec45d64732fe4aac9fe6b9d6cd04a6f4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:31.624783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec45d64732fe4aac9fe6b9d6cd04a6f4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:31.684501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec45d64732fe4aac9fe6b9d6cd04a6f4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:31.685167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec45d64732fe4aac9fe6b9d6cd04a6f4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:31.685794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec45d64732fe4aac9fe6b9d6cd04a6f4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:31.704818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1238/2454] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:09:31 2022] DELETE /identity/v3/users/ec45d64732fe4aac9fe6b9d6cd04a6f4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:31.982143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bff1d-8e8d-42cf-84b3-bdd350dbea09 service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:31.994757 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bff1d-8e8d-42cf-84b3-bdd350dbea09 service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:32.058840 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:32.059489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:32.059771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:32.060048 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] PATH_INFO: `/v3/projects/78f2a5cc4b7d4699ad5b00d3f3a9830e` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:32.061256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f2a5cc4b7d4699ad5b00d3f3a9830e)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:32.063170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:32.175267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'request_id': 'req-bc9063aa-1a31-450b-8577-daa4f9e7594f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:32.182129 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'request_id': 'req-bc9063aa-1a31-450b-8577-daa4f9e7594f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:32.256322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'request_id': 'req-bc9063aa-1a31-450b-8577-daa4f9e7594f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:32.268278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] The token cache is being invalidate because project 78f2a5cc4b7d4699ad5b00d3f3a9830e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:09:32.268564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:32.269266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:32.272261 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1217/2455] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:09:31 2022] DELETE /identity/v3/projects/78f2a5cc4b7d4699ad5b00d3f3a9830e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:38.129099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:38.130540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:38.187586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8452-4aeb-43ba-81aa-30e00f219d77 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:38.219947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:38.237726 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb3ef9-3a03-4828-9cf1-e4f4ac9ba2dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:38.237726 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb3ef9-3a03-4828-9cf1-e4f4ac9ba2dd service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:38.238033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb3ef9-3a03-4828-9cf1-e4f4ac9ba2dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:38.238235 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb3ef9-3a03-4828-9cf1-e4f4ac9ba2dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:38.239983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7abb3ef9-3a03-4828-9cf1-e4f4ac9ba2dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:38.309098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb3ef9-3a03-4828-9cf1-e4f4ac9ba2dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:38.310596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb3ef9-3a03-4828-9cf1-e4f4ac9ba2dd service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:38.321636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1239/2456] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:09:41.852284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:41.858289 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:41.937075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9063aa-1a31-450b-8577-daa4f9e7594f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:41.942230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f98df4-b9e5-4f0a-a2f3-0501af1856e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:41.951805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f98df4-b9e5-4f0a-a2f3-0501af1856e4 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:41.951805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f98df4-b9e5-4f0a-a2f3-0501af1856e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:41.951805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f98df4-b9e5-4f0a-a2f3-0501af1856e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:41.951805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e9f98df4-b9e5-4f0a-a2f3-0501af1856e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:41.958239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f98df4-b9e5-4f0a-a2f3-0501af1856e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:41.959826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f98df4-b9e5-4f0a-a2f3-0501af1856e4 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:41.971159 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1218/2457] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:09:42.013355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb3ef9-3a03-4828-9cf1-e4f4ac9ba2dd service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:42.014875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7abb3ef9-3a03-4828-9cf1-e4f4ac9ba2dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:42.027923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb3ef9-3a03-4828-9cf1-e4f4ac9ba2dd service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:42.034183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:42.034845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:42.035132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:42.035409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] PATH_INFO: `/v3/users/61d3b5a3082a4c74a2a08007581388c0` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:42.036606 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d3b5a3082a4c74a2a08007581388c0)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:42.039214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:42.276479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d3b5a3082a4c74a2a08007581388c0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:42.285384 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d3b5a3082a4c74a2a08007581388c0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:42.387247 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d3b5a3082a4c74a2a08007581388c0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:42.393407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d3b5a3082a4c74a2a08007581388c0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:42.393407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d3b5a3082a4c74a2a08007581388c0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:42.408151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1240/2458] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:09:42 2022] DELETE /identity/v3/users/61d3b5a3082a4c74a2a08007581388c0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:42.624328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f98df4-b9e5-4f0a-a2f3-0501af1856e4 service placement] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:42.625837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e9f98df4-b9e5-4f0a-a2f3-0501af1856e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:42.635781 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:42.679503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:42.685295 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:42.706795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f98df4-b9e5-4f0a-a2f3-0501af1856e4 service placement] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:42.749499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:42.754583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccb92c-8251-4e90-a40e-c81e57ce4485 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:42.760042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:42.760702 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:42.760988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:42.761299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] PATH_INFO: `/v3/projects/d37d3446345749b28d847313e1e6c488` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:42.762490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37d3446345749b28d847313e1e6c488)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:42.764464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:42.776754 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a65e1-6fb1-44ff-913c-f2812e11711d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:42.777494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a65e1-6fb1-44ff-913c-f2812e11711d service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:42.777777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a65e1-6fb1-44ff-913c-f2812e11711d service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:42.778081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a65e1-6fb1-44ff-913c-f2812e11711d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:42.779847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-055a65e1-6fb1-44ff-913c-f2812e11711d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:42.840898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a65e1-6fb1-44ff-913c-f2812e11711d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:42.842561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a65e1-6fb1-44ff-913c-f2812e11711d service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:42.852865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1219/2459] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:09:42.863897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37d3446345749b28d847313e1e6c488', 'request_id': 'req-908753ec-7248-4717-b744-4022fb63e1b9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:42.870335 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37d3446345749b28d847313e1e6c488', 'request_id': 'req-908753ec-7248-4717-b744-4022fb63e1b9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:42.877177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37d3446345749b28d847313e1e6c488', 'request_id': 'req-908753ec-7248-4717-b744-4022fb63e1b9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:42.981214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] The token cache is being invalidate because project d37d3446345749b28d847313e1e6c488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:09:42.981508 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:42.982141 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-908753ec-7248-4717-b744-4022fb63e1b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:42.983985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1241/2460] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:09:42 2022] DELETE /identity/v3/projects/d37d3446345749b28d847313e1e6c488 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:42.988835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873690c7-43fc-442c-a7b2-91c6dd798214 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:42.989153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873690c7-43fc-442c-a7b2-91c6dd798214 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:42.989426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873690c7-43fc-442c-a7b2-91c6dd798214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:43.009998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-873690c7-43fc-442c-a7b2-91c6dd798214 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:09:43.011142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-873690c7-43fc-442c-a7b2-91c6dd798214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:43.053780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:43.075361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1220/2461] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:09:43.083240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc5f7-3bc8-4477-aa52-5f008348376f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:43.083750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc5f7-3bc8-4477-aa52-5f008348376f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:43.083853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc5f7-3bc8-4477-aa52-5f008348376f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:43.105252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6e6bc5f7-3bc8-4477-aa52-5f008348376f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:09:43.105252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6e6bc5f7-3bc8-4477-aa52-5f008348376f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:43.113340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1242/2462] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:09:43.118326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873690c7-43fc-442c-a7b2-91c6dd798214 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:43.128113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873690c7-43fc-442c-a7b2-91c6dd798214 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:43.133751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422528a9-57d8-47b7-9571-cdd7c0fa3069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:43.134364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422528a9-57d8-47b7-9571-cdd7c0fa3069 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:43.134646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422528a9-57d8-47b7-9571-cdd7c0fa3069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:43.134921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422528a9-57d8-47b7-9571-cdd7c0fa3069 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:43.135612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422528a9-57d8-47b7-9571-cdd7c0fa3069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:09:43.135935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422528a9-57d8-47b7-9571-cdd7c0fa3069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:43.137558 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422528a9-57d8-47b7-9571-cdd7c0fa3069 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:43.150568 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1221/2463] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:09:43.155066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bc5f7-3bc8-4477-aa52-5f008348376f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:43.164543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bc5f7-3bc8-4477-aa52-5f008348376f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:43.169325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623284d-4cbb-4cb6-9ffe-178aef1b20b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:43.169943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623284d-4cbb-4cb6-9ffe-178aef1b20b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:43.170226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623284d-4cbb-4cb6-9ffe-178aef1b20b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:43.170504 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623284d-4cbb-4cb6-9ffe-178aef1b20b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:43.171261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623284d-4cbb-4cb6-9ffe-178aef1b20b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:43.173166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623284d-4cbb-4cb6-9ffe-178aef1b20b5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:43.280889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1243/2464] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:09:43 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:09:43.284997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422528a9-57d8-47b7-9571-cdd7c0fa3069 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:43.295218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422528a9-57d8-47b7-9571-cdd7c0fa3069 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:43.353445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed847665-852d-465e-b804-8fca9ceddaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:43.354068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed847665-852d-465e-b804-8fca9ceddaef admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:43.354353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed847665-852d-465e-b804-8fca9ceddaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:43.354629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed847665-852d-465e-b804-8fca9ceddaef admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:43.355308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed847665-852d-465e-b804-8fca9ceddaef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:43.357256 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed847665-852d-465e-b804-8fca9ceddaef admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:43.456797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1222/2465] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:09:43 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:09:43.461414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623284d-4cbb-4cb6-9ffe-178aef1b20b5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:43.472226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623284d-4cbb-4cb6-9ffe-178aef1b20b5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:43.477999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d57cb-bc2f-4d8d-9245-a7cde0de78c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:43.478695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d57cb-bc2f-4d8d-9245-a7cde0de78c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:43.479044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d57cb-bc2f-4d8d-9245-a7cde0de78c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:43.479405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d57cb-bc2f-4d8d-9245-a7cde0de78c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:43.480174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d57cb-bc2f-4d8d-9245-a7cde0de78c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:43.481922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d57cb-bc2f-4d8d-9245-a7cde0de78c4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:43.493388 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1244/2466] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:09:43.497708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed847665-852d-465e-b804-8fca9ceddaef admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:43.508232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed847665-852d-465e-b804-8fca9ceddaef admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:43.512878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cdbab-04bd-4bf9-9511-48110057bb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:43.513524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cdbab-04bd-4bf9-9511-48110057bb10 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:43.513808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cdbab-04bd-4bf9-9511-48110057bb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:43.522458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cdbab-04bd-4bf9-9511-48110057bb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:43.522458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cdbab-04bd-4bf9-9511-48110057bb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:43.522458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cdbab-04bd-4bf9-9511-48110057bb10 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:43.527399 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1223/2467] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:09:43.531888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d57cb-bc2f-4d8d-9245-a7cde0de78c4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:43.543075 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d57cb-bc2f-4d8d-9245-a7cde0de78c4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:43.547770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3101c-441d-4996-baf6-bbed26e216b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:43.548441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3101c-441d-4996-baf6-bbed26e216b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:43.551595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3101c-441d-4996-baf6-bbed26e216b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:43.551595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3101c-441d-4996-baf6-bbed26e216b8 admin admin] PATH_INFO: `/v3/projects/2c8cb9af06ab4ab8aad85ded41095126/users/244806b9aaf24471a8cad381c1b71dfe/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:43.564901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3101c-441d-4996-baf6-bbed26e216b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8cb9af06ab4ab8aad85ded41095126, user_id=244806b9aaf24471a8cad381c1b71dfe, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:43.567771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3101c-441d-4996-baf6-bbed26e216b8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:43.651331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1245/2468] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:09:43 2022] PUT /identity/v3/projects/2c8cb9af06ab4ab8aad85ded41095126/users/244806b9aaf24471a8cad381c1b71dfe/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:43.662745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b42f0-05bf-4c22-8f07-b93dbad0addf None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:43.663049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b42f0-05bf-4c22-8f07-b93dbad0addf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:43.663308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b42f0-05bf-4c22-8f07-b93dbad0addf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:43.692507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-260b42f0-05bf-4c22-8f07-b93dbad0addf None None] MFA Rules not processed for user `244806b9aaf24471a8cad381c1b71dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:09:43.693745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-260b42f0-05bf-4c22-8f07-b93dbad0addf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:43.760098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1224/2469] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:09:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:09:43.771660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3101c-441d-4996-baf6-bbed26e216b8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:43.773568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-95d3101c-441d-4996-baf6-bbed26e216b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:43.848366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3101c-441d-4996-baf6-bbed26e216b8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:43.855081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2504a-49bd-4384-876f-cb0d302ab516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:43.855722 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2504a-49bd-4384-876f-cb0d302ab516 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:43.856004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2504a-49bd-4384-876f-cb0d302ab516 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:43.856279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2504a-49bd-4384-876f-cb0d302ab516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:43.864921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2504a-49bd-4384-876f-cb0d302ab516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:43.866594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2504a-49bd-4384-876f-cb0d302ab516 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:43.875727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1246/2470] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:09:52.128680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b42f0-05bf-4c22-8f07-b93dbad0addf None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:52.169370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:52.190774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b42f0-05bf-4c22-8f07-b93dbad0addf None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:52.195562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:52.196230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:52.196504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:52.196773 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] PATH_INFO: `/v3/users/244806b9aaf24471a8cad381c1b71dfe` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:52.197960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244806b9aaf24471a8cad381c1b71dfe)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:52.199916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:52.424957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244806b9aaf24471a8cad381c1b71dfe'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:52.425570 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244806b9aaf24471a8cad381c1b71dfe'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:52.512670 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244806b9aaf24471a8cad381c1b71dfe'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:52.526439 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244806b9aaf24471a8cad381c1b71dfe'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:52.533354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244806b9aaf24471a8cad381c1b71dfe'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:52.539496 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1225/2471] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:09:52 2022] DELETE /identity/v3/users/244806b9aaf24471a8cad381c1b71dfe => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:52.544285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c2e90-b733-4a71-8054-b8bccd113fa6 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:52.544780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c2e90-b733-4a71-8054-b8bccd113fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:52.544886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c2e90-b733-4a71-8054-b8bccd113fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:52.564374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d83c2e90-b733-4a71-8054-b8bccd113fa6 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:09:52.565622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d83c2e90-b733-4a71-8054-b8bccd113fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:52.569626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:52.625023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1247/2472] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:09:52.635735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:52.637243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:52.694346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c919ba-1c18-49ed-b5d3-6223e85d9563 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:52.698857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37498653-98de-40c0-afaf-5062fb89797c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:52.699577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498653-98de-40c0-afaf-5062fb89797c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:52.699878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498653-98de-40c0-afaf-5062fb89797c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:52.700160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498653-98de-40c0-afaf-5062fb89797c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:52.709347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37498653-98de-40c0-afaf-5062fb89797c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:52.710793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37498653-98de-40c0-afaf-5062fb89797c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:52.721015 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1226/2473] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:09:53.149453 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c2e90-b733-4a71-8054-b8bccd113fa6 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:53.151030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d83c2e90-b733-4a71-8054-b8bccd113fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:53.164204 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c2e90-b733-4a71-8054-b8bccd113fa6 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:53.169956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:53.170546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:53.171009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:53.171300 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] PATH_INFO: `/v3/projects/2c8cb9af06ab4ab8aad85ded41095126` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:53.172529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8cb9af06ab4ab8aad85ded41095126)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:53.174525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:53.262608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8cb9af06ab4ab8aad85ded41095126', 'request_id': 'req-1848c6ab-2ef2-46af-8ec1-3441768b23e3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:53.268960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8cb9af06ab4ab8aad85ded41095126', 'request_id': 'req-1848c6ab-2ef2-46af-8ec1-3441768b23e3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:53.274913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8cb9af06ab4ab8aad85ded41095126', 'request_id': 'req-1848c6ab-2ef2-46af-8ec1-3441768b23e3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:53.345585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] The token cache is being invalidate because project 2c8cb9af06ab4ab8aad85ded41095126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:09:53.345877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:53.346482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1848c6ab-2ef2-46af-8ec1-3441768b23e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:53.348009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1248/2474] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:09:53 2022] DELETE /identity/v3/projects/2c8cb9af06ab4ab8aad85ded41095126 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:53.354286 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477043-b827-4756-864a-4b17843e80a9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:53.354814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477043-b827-4756-864a-4b17843e80a9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:53.354814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477043-b827-4756-864a-4b17843e80a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:53.376351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c7477043-b827-4756-864a-4b17843e80a9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:09:53.377581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c7477043-b827-4756-864a-4b17843e80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:53.433527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:53.442175 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1227/2475] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:09:53.450792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01477e6f-2ef6-4d28-aa13-be4783d0e710 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:53.451081 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01477e6f-2ef6-4d28-aa13-be4783d0e710 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:53.451364 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01477e6f-2ef6-4d28-aa13-be4783d0e710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:53.472033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-01477e6f-2ef6-4d28-aa13-be4783d0e710 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:09:53.477149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-01477e6f-2ef6-4d28-aa13-be4783d0e710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:53.482073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1249/2476] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:09:53.486269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7477043-b827-4756-864a-4b17843e80a9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:53.496732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7477043-b827-4756-864a-4b17843e80a9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:53.501474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123ad24-8b01-454e-93dd-e52644d9c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:53.502083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ad24-8b01-454e-93dd-e52644d9c96a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:53.502360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ad24-8b01-454e-93dd-e52644d9c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:53.502633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ad24-8b01-454e-93dd-e52644d9c96a admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:53.503318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123ad24-8b01-454e-93dd-e52644d9c96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:09:53.503625 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123ad24-8b01-454e-93dd-e52644d9c96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:53.505249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123ad24-8b01-454e-93dd-e52644d9c96a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:53.522957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1228/2477] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:09:53.523158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01477e6f-2ef6-4d28-aa13-be4783d0e710 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:53.531598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01477e6f-2ef6-4d28-aa13-be4783d0e710 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:53.536633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45454f48-d36e-41bd-8548-dbb2c7edf38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:53.537295 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45454f48-d36e-41bd-8548-dbb2c7edf38d admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:53.537577 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45454f48-d36e-41bd-8548-dbb2c7edf38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:53.537851 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45454f48-d36e-41bd-8548-dbb2c7edf38d admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:53.538518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45454f48-d36e-41bd-8548-dbb2c7edf38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:53.541299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45454f48-d36e-41bd-8548-dbb2c7edf38d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:53.634641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1250/2478] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:09:53 2022] POST /identity/v3/projects => generated 401 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:09:53.638887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123ad24-8b01-454e-93dd-e52644d9c96a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:53.649817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123ad24-8b01-454e-93dd-e52644d9c96a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:53.705011 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac466b9-ffe4-492b-a9b4-108c769e236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:53.705666 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac466b9-ffe4-492b-a9b4-108c769e236a admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:53.705951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac466b9-ffe4-492b-a9b4-108c769e236a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:53.706224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac466b9-ffe4-492b-a9b4-108c769e236a admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:53.706885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac466b9-ffe4-492b-a9b4-108c769e236a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:53.708812 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac466b9-ffe4-492b-a9b4-108c769e236a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:53.822255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1229/2479] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:09:53 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:09:53.826363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45454f48-d36e-41bd-8548-dbb2c7edf38d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:53.837466 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45454f48-d36e-41bd-8548-dbb2c7edf38d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:53.842219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088d4a1-d921-4f40-9844-e982fd7e02a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:53.842840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088d4a1-d921-4f40-9844-e982fd7e02a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:53.843123 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088d4a1-d921-4f40-9844-e982fd7e02a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:53.843411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088d4a1-d921-4f40-9844-e982fd7e02a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:53.844097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088d4a1-d921-4f40-9844-e982fd7e02a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:53.845750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088d4a1-d921-4f40-9844-e982fd7e02a6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:53.856928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1251/2480] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:09:53.861088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac466b9-ffe4-492b-a9b4-108c769e236a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:53.871450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac466b9-ffe4-492b-a9b4-108c769e236a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:53.876212 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b4bc5-33bd-4a96-a060-c7d9e04e2743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:53.876825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b4bc5-33bd-4a96-a060-c7d9e04e2743 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:53.877106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b4bc5-33bd-4a96-a060-c7d9e04e2743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:53.877419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b4bc5-33bd-4a96-a060-c7d9e04e2743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:53.878116 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b4bc5-33bd-4a96-a060-c7d9e04e2743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:53.879736 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b4bc5-33bd-4a96-a060-c7d9e04e2743 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:53.891217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1230/2481] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:09:53.895485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088d4a1-d921-4f40-9844-e982fd7e02a6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:53.907172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088d4a1-d921-4f40-9844-e982fd7e02a6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:53.911810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523c903-4f24-4daa-bbe0-aceb24a8bdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:53.912482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523c903-4f24-4daa-bbe0-aceb24a8bdae admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:53.912757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523c903-4f24-4daa-bbe0-aceb24a8bdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:53.913032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523c903-4f24-4daa-bbe0-aceb24a8bdae admin admin] PATH_INFO: `/v3/projects/e13bca30a0e74772a837dde829feef25/users/cf04b314248144edbfde00d205db7d57/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:54.057640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523c903-4f24-4daa-bbe0-aceb24a8bdae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13bca30a0e74772a837dde829feef25, user_id=cf04b314248144edbfde00d205db7d57, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:54.060313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523c903-4f24-4daa-bbe0-aceb24a8bdae admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:54.143166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1252/2482] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:09:53 2022] PUT /identity/v3/projects/e13bca30a0e74772a837dde829feef25/users/cf04b314248144edbfde00d205db7d57/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:54.154711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278242-9957-48eb-9e72-014a89388e6c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:54.155292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278242-9957-48eb-9e72-014a89388e6c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:54.155760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278242-9957-48eb-9e72-014a89388e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:54.185947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-92278242-9957-48eb-9e72-014a89388e6c None None] MFA Rules not processed for user `cf04b314248144edbfde00d205db7d57`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:09:54.187171 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-92278242-9957-48eb-9e72-014a89388e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:54.255976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1231/2483] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:09:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:09:54.261012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523c903-4f24-4daa-bbe0-aceb24a8bdae admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:54.291522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:54.331264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523c903-4f24-4daa-bbe0-aceb24a8bdae admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:54.335980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534da55-194e-4310-9934-ac985bbab3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:54.336604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534da55-194e-4310-9934-ac985bbab3db admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:54.336910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534da55-194e-4310-9934-ac985bbab3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:54.337629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534da55-194e-4310-9934-ac985bbab3db admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:54.338099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534da55-194e-4310-9934-ac985bbab3db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:54.340015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534da55-194e-4310-9934-ac985bbab3db admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:54.447855 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1253/2484] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:09:54 2022] POST /identity/v3/projects => generated 401 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:09:54.452036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92278242-9957-48eb-9e72-014a89388e6c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:54.463057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92278242-9957-48eb-9e72-014a89388e6c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:54.513724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:54.520513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208feeed-69d1-4839-bda3-aa55c7d1359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:54.521440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208feeed-69d1-4839-bda3-aa55c7d1359a admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:54.526281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208feeed-69d1-4839-bda3-aa55c7d1359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:54.526281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208feeed-69d1-4839-bda3-aa55c7d1359a admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:54.526281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208feeed-69d1-4839-bda3-aa55c7d1359a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:54.526281 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208feeed-69d1-4839-bda3-aa55c7d1359a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:54.603902 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1232/2485] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:09:54 2022] POST /identity/v3/users => generated 307 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:09:54.608088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534da55-194e-4310-9934-ac985bbab3db admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:54.619132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534da55-194e-4310-9934-ac985bbab3db admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:54.623761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0b251-5ff9-4c5b-b35c-0a928f32cf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:54.624370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0b251-5ff9-4c5b-b35c-0a928f32cf8a admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:54.624656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0b251-5ff9-4c5b-b35c-0a928f32cf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:54.624934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0b251-5ff9-4c5b-b35c-0a928f32cf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:54.625660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0b251-5ff9-4c5b-b35c-0a928f32cf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:54.627263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0b251-5ff9-4c5b-b35c-0a928f32cf8a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:54.637704 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1254/2486] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:09:54.642417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208feeed-69d1-4839-bda3-aa55c7d1359a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:54.653462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208feeed-69d1-4839-bda3-aa55c7d1359a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:54.658014 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c1d20-3c1a-4c19-b7fa-72564bb669b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:54.658722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c1d20-3c1a-4c19-b7fa-72564bb669b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:54.659031 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c1d20-3c1a-4c19-b7fa-72564bb669b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:54.659307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c1d20-3c1a-4c19-b7fa-72564bb669b1 admin admin] PATH_INFO: `/v3/projects/f501dfdf8bf94ce18dbb963eff6b7519/users/4ea10a5697b146b68842e154ab3a63ae/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:54.674521 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c1d20-3c1a-4c19-b7fa-72564bb669b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f501dfdf8bf94ce18dbb963eff6b7519, user_id=4ea10a5697b146b68842e154ab3a63ae, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:54.677251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c1d20-3c1a-4c19-b7fa-72564bb669b1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:54.746748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1233/2487] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:09:54 2022] PUT /identity/v3/projects/f501dfdf8bf94ce18dbb963eff6b7519/users/4ea10a5697b146b68842e154ab3a63ae/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:54.751006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0b251-5ff9-4c5b-b35c-0a928f32cf8a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:54.761621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0b251-5ff9-4c5b-b35c-0a928f32cf8a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:54.818251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1935fc-d15c-4f6a-8d2d-f7f4d671ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:54.818868 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1935fc-d15c-4f6a-8d2d-f7f4d671ef05 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:54.819145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1935fc-d15c-4f6a-8d2d-f7f4d671ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:54.819417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1935fc-d15c-4f6a-8d2d-f7f4d671ef05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:54.820100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1935fc-d15c-4f6a-8d2d-f7f4d671ef05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:54.822370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1935fc-d15c-4f6a-8d2d-f7f4d671ef05 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:54.831889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1255/2488] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:09:54.836180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c1d20-3c1a-4c19-b7fa-72564bb669b1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:54.846899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c1d20-3c1a-4c19-b7fa-72564bb669b1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:54.851655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62dd6b-5a47-48c2-bdb2-126a47ad6c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:54.852325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62dd6b-5a47-48c2-bdb2-126a47ad6c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:54.853285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62dd6b-5a47-48c2-bdb2-126a47ad6c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:54.853856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62dd6b-5a47-48c2-bdb2-126a47ad6c2e admin admin] PATH_INFO: `/v3/projects/f501dfdf8bf94ce18dbb963eff6b7519/users/4ea10a5697b146b68842e154ab3a63ae/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:54.855505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62dd6b-5a47-48c2-bdb2-126a47ad6c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f501dfdf8bf94ce18dbb963eff6b7519, user_id=4ea10a5697b146b68842e154ab3a63ae, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:54.858155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62dd6b-5a47-48c2-bdb2-126a47ad6c2e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:54.869566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1234/2489] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:09:54 2022] PUT /identity/v3/projects/f501dfdf8bf94ce18dbb963eff6b7519/users/4ea10a5697b146b68842e154ab3a63ae/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:54.881026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0ff88-ec3b-4443-a630-2227d6363e76 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:54.881339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0ff88-ec3b-4443-a630-2227d6363e76 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:54.881608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0ff88-ec3b-4443-a630-2227d6363e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:54.909060 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-08a0ff88-ec3b-4443-a630-2227d6363e76 None None] MFA Rules not processed for user `4ea10a5697b146b68842e154ab3a63ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:09:54.910307 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-08a0ff88-ec3b-4443-a630-2227d6363e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:54.976008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1256/2490] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:09:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:09:54.987532 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62dd6b-5a47-48c2-bdb2-126a47ad6c2e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:54.989282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cc62dd6b-5a47-48c2-bdb2-126a47ad6c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:55.049620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62dd6b-5a47-48c2-bdb2-126a47ad6c2e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:55.053294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30e913-d0f2-4a24-8dc4-900aa429b65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:55.053906 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30e913-d0f2-4a24-8dc4-900aa429b65e service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:55.054188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30e913-d0f2-4a24-8dc4-900aa429b65e service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:55.054463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30e913-d0f2-4a24-8dc4-900aa429b65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:55.063588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30e913-d0f2-4a24-8dc4-900aa429b65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:55.065029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30e913-d0f2-4a24-8dc4-900aa429b65e service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:55.074606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1235/2491] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:09:55.314503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0ff88-ec3b-4443-a630-2227d6363e76 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:55.324589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0ff88-ec3b-4443-a630-2227d6363e76 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:55.328457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0ff43-5860-4b02-8182-de051760b89a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:55.332779 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0ff43-5860-4b02-8182-de051760b89a service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:55.332779 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0ff43-5860-4b02-8182-de051760b89a service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:55.332779 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0ff43-5860-4b02-8182-de051760b89a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:55.355543 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:55.394416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0ff43-5860-4b02-8182-de051760b89a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:55.395857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0ff43-5860-4b02-8182-de051760b89a service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:55.407026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1257/2492] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:09:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:00.493285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30e913-d0f2-4a24-8dc4-900aa429b65e service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:00.558004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30e913-d0f2-4a24-8dc4-900aa429b65e service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:00.562601 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:00.563316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:00.563597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:00.563873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] PATH_INFO: `/v3/users/cf04b314248144edbfde00d205db7d57` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:00.565111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf04b314248144edbfde00d205db7d57)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:00.567064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:00.732723 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf04b314248144edbfde00d205db7d57'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:00.733412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf04b314248144edbfde00d205db7d57'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:00.737102 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:00.796451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf04b314248144edbfde00d205db7d57'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:00.810105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf04b314248144edbfde00d205db7d57'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:00.816765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf04b314248144edbfde00d205db7d57'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:00.822676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1236/2493] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:10:00 2022] DELETE /identity/v3/users/cf04b314248144edbfde00d205db7d57 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:00.827296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140885-35c1-47ce-9d99-6cb6e2218a27 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:00.827766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140885-35c1-47ce-9d99-6cb6e2218a27 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:00.827933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140885-35c1-47ce-9d99-6cb6e2218a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:00.847224 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2d140885-35c1-47ce-9d99-6cb6e2218a27 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:00.848455 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2d140885-35c1-47ce-9d99-6cb6e2218a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:00.915249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1258/2494] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:00.925029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:00.926486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:00.985343 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d5c7d-2c9c-4fcf-80a4-af4f6e39d951 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:00.988934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd84eae-47b2-40dd-bcd6-f28c15c20cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:00.989590 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84eae-47b2-40dd-bcd6-f28c15c20cda service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:00.989870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84eae-47b2-40dd-bcd6-f28c15c20cda service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:00.990147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84eae-47b2-40dd-bcd6-f28c15c20cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:01.000024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd84eae-47b2-40dd-bcd6-f28c15c20cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:01.001497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd84eae-47b2-40dd-bcd6-f28c15c20cda service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:01.011167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1237/2495] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:01.440624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d140885-35c1-47ce-9d99-6cb6e2218a27 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:01.442140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2d140885-35c1-47ce-9d99-6cb6e2218a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:01.455419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d140885-35c1-47ce-9d99-6cb6e2218a27 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:01.460505 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:01.461229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:01.461517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:01.461824 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] PATH_INFO: `/v3/projects/e13bca30a0e74772a837dde829feef25` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:01.463173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13bca30a0e74772a837dde829feef25)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:01.465324 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:01.574711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13bca30a0e74772a837dde829feef25', 'request_id': 'req-1446def8-2c32-4eeb-9514-cd31fe3b49f6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:01.581085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13bca30a0e74772a837dde829feef25', 'request_id': 'req-1446def8-2c32-4eeb-9514-cd31fe3b49f6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:01.586867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13bca30a0e74772a837dde829feef25', 'request_id': 'req-1446def8-2c32-4eeb-9514-cd31fe3b49f6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:01.661572 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] The token cache is being invalidate because project e13bca30a0e74772a837dde829feef25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:10:01.661906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:01.665552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:01.665552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1259/2496] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:10:01 2022] DELETE /identity/v3/projects/e13bca30a0e74772a837dde829feef25 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:01.668876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd84eae-47b2-40dd-bcd6-f28c15c20cda service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:01.679505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd84eae-47b2-40dd-bcd6-f28c15c20cda service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:01.736525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:01.737185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:01.737465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:01.737740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] PATH_INFO: `/v3/users/4ea10a5697b146b68842e154ab3a63ae` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:01.738886 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea10a5697b146b68842e154ab3a63ae)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:01.740861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:01.943448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea10a5697b146b68842e154ab3a63ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:01.944113 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea10a5697b146b68842e154ab3a63ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:02.032738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea10a5697b146b68842e154ab3a63ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:02.046342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea10a5697b146b68842e154ab3a63ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:02.048270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:02.053602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f828aa44-06b2-451b-8c66-13207f6abf5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea10a5697b146b68842e154ab3a63ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:02.059963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1238/2497] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:10:01 2022] DELETE /identity/v3/users/4ea10a5697b146b68842e154ab3a63ae => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:10:02.781101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:02.782583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:02.803530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446def8-2c32-4eeb-9514-cd31fe3b49f6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:02.851846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:02.864941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:02.865634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:02.865919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:02.866192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] PATH_INFO: `/v3/projects/f501dfdf8bf94ce18dbb963eff6b7519` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:02.867366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f501dfdf8bf94ce18dbb963eff6b7519)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:02.869984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:02.999784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f501dfdf8bf94ce18dbb963eff6b7519', 'request_id': 'req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:03.006244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f501dfdf8bf94ce18dbb963eff6b7519', 'request_id': 'req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:03.012992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f501dfdf8bf94ce18dbb963eff6b7519', 'request_id': 'req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:03.112359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] The token cache is being invalidate because project f501dfdf8bf94ce18dbb963eff6b7519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:10:03.112650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:03.113340 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf214e6a-9bb4-40c8-9d2a-b9a47133c304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:03.114837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1260/2498] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:10:02 2022] DELETE /identity/v3/projects/f501dfdf8bf94ce18dbb963eff6b7519 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:03.120615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46649-ca07-4303-9c0b-67650d090aed None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:03.121097 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46649-ca07-4303-9c0b-67650d090aed None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:03.121231 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46649-ca07-4303-9c0b-67650d090aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:03.141768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9bd46649-ca07-4303-9c0b-67650d090aed None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:03.142996 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9bd46649-ca07-4303-9c0b-67650d090aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:03.205499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1239/2499] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:03.213489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287bcc1-8e00-4977-9db0-f350d34c8f05 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:03.213776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287bcc1-8e00-4977-9db0-f350d34c8f05 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:03.214053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287bcc1-8e00-4977-9db0-f350d34c8f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:03.234435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5287bcc1-8e00-4977-9db0-f350d34c8f05 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:03.235866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5287bcc1-8e00-4977-9db0-f350d34c8f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:03.245451 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1261/2500] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:03.249673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd46649-ca07-4303-9c0b-67650d090aed None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:03.259820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd46649-ca07-4303-9c0b-67650d090aed None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:03.264546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9243e-5b6d-43c9-8d6b-9480abb6715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:03.265178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9243e-5b6d-43c9-8d6b-9480abb6715b admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:03.268673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9243e-5b6d-43c9-8d6b-9480abb6715b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:03.268673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9243e-5b6d-43c9-8d6b-9480abb6715b admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:03.268673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9243e-5b6d-43c9-8d6b-9480abb6715b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:10:03.268673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9243e-5b6d-43c9-8d6b-9480abb6715b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:03.268673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9243e-5b6d-43c9-8d6b-9480abb6715b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:03.281574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1240/2501] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:10:03.286267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287bcc1-8e00-4977-9db0-f350d34c8f05 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:03.296705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287bcc1-8e00-4977-9db0-f350d34c8f05 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:03.301480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee69298-365a-4320-9393-a094361d62cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:03.302091 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee69298-365a-4320-9393-a094361d62cd admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:03.302371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee69298-365a-4320-9393-a094361d62cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:03.302761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee69298-365a-4320-9393-a094361d62cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:03.303426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee69298-365a-4320-9393-a094361d62cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:03.305374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee69298-365a-4320-9393-a094361d62cd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:03.444571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1262/2502] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:10:03 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:10:03.448961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9243e-5b6d-43c9-8d6b-9480abb6715b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:03.459060 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9243e-5b6d-43c9-8d6b-9480abb6715b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:03.515511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465022ed-0fd6-4d21-9502-9ab4f8af6ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:03.515952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465022ed-0fd6-4d21-9502-9ab4f8af6ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:03.516234 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465022ed-0fd6-4d21-9502-9ab4f8af6ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:03.516501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465022ed-0fd6-4d21-9502-9ab4f8af6ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:03.517200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465022ed-0fd6-4d21-9502-9ab4f8af6ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:03.519120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465022ed-0fd6-4d21-9502-9ab4f8af6ce4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:03.633297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1241/2503] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:10:03 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:03.638106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee69298-365a-4320-9393-a094361d62cd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:03.648564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee69298-365a-4320-9393-a094361d62cd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:03.653838 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093b737-2592-4eb7-a0b2-ec85302edc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:03.654451 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093b737-2592-4eb7-a0b2-ec85302edc59 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:03.654729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093b737-2592-4eb7-a0b2-ec85302edc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:03.654998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093b737-2592-4eb7-a0b2-ec85302edc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:03.655686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093b737-2592-4eb7-a0b2-ec85302edc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:03.657296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093b737-2592-4eb7-a0b2-ec85302edc59 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:03.668265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1263/2504] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:03.672367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465022ed-0fd6-4d21-9502-9ab4f8af6ce4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:03.682689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465022ed-0fd6-4d21-9502-9ab4f8af6ce4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:03.687370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fb45a-9bb7-4edc-8762-b2dea6c6a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:03.687970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fb45a-9bb7-4edc-8762-b2dea6c6a600 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:03.688247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fb45a-9bb7-4edc-8762-b2dea6c6a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:03.688516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fb45a-9bb7-4edc-8762-b2dea6c6a600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:03.689235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fb45a-9bb7-4edc-8762-b2dea6c6a600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:03.690830 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fb45a-9bb7-4edc-8762-b2dea6c6a600 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:03.702252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1242/2505] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:10:03.706679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093b737-2592-4eb7-a0b2-ec85302edc59 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:03.717449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093b737-2592-4eb7-a0b2-ec85302edc59 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:03.722023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7451e2-4f10-4e71-9433-45a5687d667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:03.722679 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7451e2-4f10-4e71-9433-45a5687d667a admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:03.722956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7451e2-4f10-4e71-9433-45a5687d667a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:03.723229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7451e2-4f10-4e71-9433-45a5687d667a admin admin] PATH_INFO: `/v3/projects/f3b8a8c1c4e0425d90c2103bea59756b/users/189b77dcaae24f9384d2d4d6fb1d63e4/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:03.738893 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7451e2-4f10-4e71-9433-45a5687d667a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b8a8c1c4e0425d90c2103bea59756b, user_id=189b77dcaae24f9384d2d4d6fb1d63e4, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:03.741634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7451e2-4f10-4e71-9433-45a5687d667a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:03.822862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1264/2506] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:10:03 2022] PUT /identity/v3/projects/f3b8a8c1c4e0425d90c2103bea59756b/users/189b77dcaae24f9384d2d4d6fb1d63e4/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:03.834241 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f56c7-c2e5-4eff-86c7-f5d65b1f564b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:03.834529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f56c7-c2e5-4eff-86c7-f5d65b1f564b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:03.834807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f56c7-c2e5-4eff-86c7-f5d65b1f564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:03.887681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-895f56c7-c2e5-4eff-86c7-f5d65b1f564b None None] MFA Rules not processed for user `189b77dcaae24f9384d2d4d6fb1d63e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:03.889024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-895f56c7-c2e5-4eff-86c7-f5d65b1f564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:03.932887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:03.981943 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1243/2507] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:10:03.986311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7451e2-4f10-4e71-9433-45a5687d667a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:04.056166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:04.098014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7451e2-4f10-4e71-9433-45a5687d667a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:04.104024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe636f-3964-4383-ba9b-ad24b5888899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:04.104644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe636f-3964-4383-ba9b-ad24b5888899 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:04.104921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe636f-3964-4383-ba9b-ad24b5888899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:04.105226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe636f-3964-4383-ba9b-ad24b5888899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:04.105934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe636f-3964-4383-ba9b-ad24b5888899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:04.108199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe636f-3964-4383-ba9b-ad24b5888899 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:04.194419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1265/2508] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:10:03 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:04.198963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f56c7-c2e5-4eff-86c7-f5d65b1f564b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:04.210400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f56c7-c2e5-4eff-86c7-f5d65b1f564b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:04.275239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa214bb-2a9d-4546-90cb-cc3c4c0ee2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:04.276020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa214bb-2a9d-4546-90cb-cc3c4c0ee2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:04.276379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa214bb-2a9d-4546-90cb-cc3c4c0ee2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:04.276733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa214bb-2a9d-4546-90cb-cc3c4c0ee2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:04.277645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa214bb-2a9d-4546-90cb-cc3c4c0ee2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:04.279925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa214bb-2a9d-4546-90cb-cc3c4c0ee2f5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:04.398266 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1244/2509] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:10:04 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:04.402910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe636f-3964-4383-ba9b-ad24b5888899 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:04.413211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe636f-3964-4383-ba9b-ad24b5888899 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:04.418560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65440-4105-41d0-9d7d-d4539a8c9631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:04.419218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65440-4105-41d0-9d7d-d4539a8c9631 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:04.419501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65440-4105-41d0-9d7d-d4539a8c9631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:04.419796 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65440-4105-41d0-9d7d-d4539a8c9631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:04.420489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb65440-4105-41d0-9d7d-d4539a8c9631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:04.422127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb65440-4105-41d0-9d7d-d4539a8c9631 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:04.432595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1266/2510] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:04.436802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa214bb-2a9d-4546-90cb-cc3c4c0ee2f5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:04.447916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa214bb-2a9d-4546-90cb-cc3c4c0ee2f5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:04.452719 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933e9ed-0be6-458a-95d9-13e8c47ae0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:04.453367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933e9ed-0be6-458a-95d9-13e8c47ae0ac admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:04.453651 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933e9ed-0be6-458a-95d9-13e8c47ae0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:04.453932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933e9ed-0be6-458a-95d9-13e8c47ae0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:04.454715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933e9ed-0be6-458a-95d9-13e8c47ae0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:04.464200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933e9ed-0be6-458a-95d9-13e8c47ae0ac admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:04.467491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1245/2511] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:04.471565 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65440-4105-41d0-9d7d-d4539a8c9631 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:04.481475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65440-4105-41d0-9d7d-d4539a8c9631 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:04.486005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11632f-3e70-49e4-b4bd-02ab75853f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:04.486666 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11632f-3e70-49e4-b4bd-02ab75853f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:04.486946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11632f-3e70-49e4-b4bd-02ab75853f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:04.487215 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11632f-3e70-49e4-b4bd-02ab75853f1e admin admin] PATH_INFO: `/v3/projects/185fd3704cb642029e5a224e0dc7e796/users/fa4178805940458eaccd545f1ac42729/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:04.502633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11632f-3e70-49e4-b4bd-02ab75853f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=185fd3704cb642029e5a224e0dc7e796, user_id=fa4178805940458eaccd545f1ac42729, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:04.505328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11632f-3e70-49e4-b4bd-02ab75853f1e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:04.593898 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1267/2512] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:10:04 2022] PUT /identity/v3/projects/185fd3704cb642029e5a224e0dc7e796/users/fa4178805940458eaccd545f1ac42729/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:04.604342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc7b0-02ac-47e1-8cda-858fce2ae5a0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:04.604640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc7b0-02ac-47e1-8cda-858fce2ae5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:04.604921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc7b0-02ac-47e1-8cda-858fce2ae5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:04.635147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-32ebc7b0-02ac-47e1-8cda-858fce2ae5a0 None None] MFA Rules not processed for user `fa4178805940458eaccd545f1ac42729`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:04.636390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-32ebc7b0-02ac-47e1-8cda-858fce2ae5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:04.701655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1246/2513] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:04.706372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11632f-3e70-49e4-b4bd-02ab75853f1e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:04.767694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11632f-3e70-49e4-b4bd-02ab75853f1e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:04.772580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a7e97-8b81-4f26-8065-81d12d2aa82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:04.773230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7e97-8b81-4f26-8065-81d12d2aa82c admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:04.773512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7e97-8b81-4f26-8065-81d12d2aa82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:04.773784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7e97-8b81-4f26-8065-81d12d2aa82c admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:04.775532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a7e97-8b81-4f26-8065-81d12d2aa82c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:04.777501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a7e97-8b81-4f26-8065-81d12d2aa82c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:04.863217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1268/2514] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:10:04 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:04.867402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebc7b0-02ac-47e1-8cda-858fce2ae5a0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:04.878843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebc7b0-02ac-47e1-8cda-858fce2ae5a0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:04.906122 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:04.936550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f8e41-10a4-464f-ad5d-57db43b7329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:04.937206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f8e41-10a4-464f-ad5d-57db43b7329e admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:04.937488 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f8e41-10a4-464f-ad5d-57db43b7329e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:04.937769 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f8e41-10a4-464f-ad5d-57db43b7329e admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:04.938535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f8e41-10a4-464f-ad5d-57db43b7329e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:04.940535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f8e41-10a4-464f-ad5d-57db43b7329e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:04.960963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b41d23-3a23-4bfa-b101-117b2bcb65e2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:04.961275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b41d23-3a23-4bfa-b101-117b2bcb65e2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:04.961598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b41d23-3a23-4bfa-b101-117b2bcb65e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:04.993628 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-31b41d23-3a23-4bfa-b101-117b2bcb65e2 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:04.995179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-31b41d23-3a23-4bfa-b101-117b2bcb65e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:05.032937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:05.048654 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1247/2515] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:10:04 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:10:05.052269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f8e41-10a4-464f-ad5d-57db43b7329e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:05.064704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f8e41-10a4-464f-ad5d-57db43b7329e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:05.070527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f40c89-fb76-4e5a-9f4b-4d1fc4226d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:05.072134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f40c89-fb76-4e5a-9f4b-4d1fc4226d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:05.072134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f40c89-fb76-4e5a-9f4b-4d1fc4226d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:05.072405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f40c89-fb76-4e5a-9f4b-4d1fc4226d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:05.072964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f40c89-fb76-4e5a-9f4b-4d1fc4226d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:05.074617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f40c89-fb76-4e5a-9f4b-4d1fc4226d2e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:05.083305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1269/2516] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:10:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:10:05.088668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1248/2517] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:05.090017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b41d23-3a23-4bfa-b101-117b2bcb65e2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:05.107108 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b41d23-3a23-4bfa-b101-117b2bcb65e2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:05.112553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bf827-4b7e-4ffa-8a89-dd171197f403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:05.113506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bf827-4b7e-4ffa-8a89-dd171197f403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:05.113506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bf827-4b7e-4ffa-8a89-dd171197f403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:05.114086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bf827-4b7e-4ffa-8a89-dd171197f403 admin admin] PATH_INFO: `/v3/projects/28de5bbb5710443ea19c0d81e7ce2d32/users/de394cad1d7d4509ad6bde9b75960626/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:05.130908 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bf827-4b7e-4ffa-8a89-dd171197f403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28de5bbb5710443ea19c0d81e7ce2d32, user_id=de394cad1d7d4509ad6bde9b75960626, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:05.134146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bf827-4b7e-4ffa-8a89-dd171197f403 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:05.236727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1270/2518] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:10:05 2022] PUT /identity/v3/projects/28de5bbb5710443ea19c0d81e7ce2d32/users/de394cad1d7d4509ad6bde9b75960626/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:10:05.240743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f40c89-fb76-4e5a-9f4b-4d1fc4226d2e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:05.251640 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f40c89-fb76-4e5a-9f4b-4d1fc4226d2e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:05.263399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bf827-4b7e-4ffa-8a89-dd171197f403 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:05.265166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d43bf827-4b7e-4ffa-8a89-dd171197f403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:05.314312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663e1c4-f7de-4890-ae68-9dc360944618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:05.314863 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e1c4-f7de-4890-ae68-9dc360944618 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:05.315147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e1c4-f7de-4890-ae68-9dc360944618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:05.315742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e1c4-f7de-4890-ae68-9dc360944618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:05.316120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663e1c4-f7de-4890-ae68-9dc360944618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:05.317783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663e1c4-f7de-4890-ae68-9dc360944618 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:05.329331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1249/2519] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:05.333758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663e1c4-f7de-4890-ae68-9dc360944618 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:05.342680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bf827-4b7e-4ffa-8a89-dd171197f403 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:05.344096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663e1c4-f7de-4890-ae68-9dc360944618 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:05.350488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee100-2fb9-43b5-9b65-1af47a2ae7c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:05.351617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee100-2fb9-43b5-9b65-1af47a2ae7c7 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:05.351740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd683d0-cbfa-479c-979e-da4fc4c03c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:05.352876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee100-2fb9-43b5-9b65-1af47a2ae7c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:05.353469 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee100-2fb9-43b5-9b65-1af47a2ae7c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:05.353683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd683d0-cbfa-479c-979e-da4fc4c03c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:05.354149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd683d0-cbfa-479c-979e-da4fc4c03c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:05.354814 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd683d0-cbfa-479c-979e-da4fc4c03c78 admin admin] PATH_INFO: `/v3/projects/28de5bbb5710443ea19c0d81e7ce2d32/users/de394cad1d7d4509ad6bde9b75960626/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:05.357953 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd683d0-cbfa-479c-979e-da4fc4c03c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28de5bbb5710443ea19c0d81e7ce2d32, user_id=de394cad1d7d4509ad6bde9b75960626, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:05.363774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd683d0-cbfa-479c-979e-da4fc4c03c78 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:05.381154 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1250/2520] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:10:05 2022] PUT /identity/v3/projects/28de5bbb5710443ea19c0d81e7ce2d32/users/de394cad1d7d4509ad6bde9b75960626/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:10:05.389726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa34f1d-47a9-4599-b558-961b3f30cc1c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:05.390084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa34f1d-47a9-4599-b558-961b3f30cc1c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:05.390424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa34f1d-47a9-4599-b558-961b3f30cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:05.423442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ffa34f1d-47a9-4599-b558-961b3f30cc1c None None] MFA Rules not processed for user `de394cad1d7d4509ad6bde9b75960626`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:05.425000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ffa34f1d-47a9-4599-b558-961b3f30cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:05.425803 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dee100-2fb9-43b5-9b65-1af47a2ae7c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:05.427399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dee100-2fb9-43b5-9b65-1af47a2ae7c7 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:05.436786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1271/2521] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:10:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 23:10:05.514621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1251/2522] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:10:05.522523 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee100-2fb9-43b5-9b65-1af47a2ae7c7 service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:05.524576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-70dee100-2fb9-43b5-9b65-1af47a2ae7c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:05.582396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:05.623073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee100-2fb9-43b5-9b65-1af47a2ae7c7 service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:05.682230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f47f55-8e56-4fcb-b2ae-91221c146743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:05.682857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f47f55-8e56-4fcb-b2ae-91221c146743 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:05.683139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f47f55-8e56-4fcb-b2ae-91221c146743 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:05.683414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f47f55-8e56-4fcb-b2ae-91221c146743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:05.695560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f47f55-8e56-4fcb-b2ae-91221c146743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:05.697757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f47f55-8e56-4fcb-b2ae-91221c146743 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:05.708514 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1272/2523] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:05.837982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa34f1d-47a9-4599-b558-961b3f30cc1c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:05.841717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ffa34f1d-47a9-4599-b558-961b3f30cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:05.873095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa34f1d-47a9-4599-b558-961b3f30cc1c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:05.882284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caecba-0aa3-4ec3-a8f1-a9df453ed046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:05.882931 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caecba-0aa3-4ec3-a8f1-a9df453ed046 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:05.883217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caecba-0aa3-4ec3-a8f1-a9df453ed046 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:05.883522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caecba-0aa3-4ec3-a8f1-a9df453ed046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:05.904535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:05.919682 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f47f55-8e56-4fcb-b2ae-91221c146743 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:05.921184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-72f47f55-8e56-4fcb-b2ae-91221c146743 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:05.968254 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caecba-0aa3-4ec3-a8f1-a9df453ed046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:05.969873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caecba-0aa3-4ec3-a8f1-a9df453ed046 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:05.983044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1252/2524] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:06.062541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f47f55-8e56-4fcb-b2ae-91221c146743 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:06.075203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d51dc-04ba-4f22-aa7a-0dc2dcca215d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:06.076456 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d51dc-04ba-4f22-aa7a-0dc2dcca215d service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:06.077083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d51dc-04ba-4f22-aa7a-0dc2dcca215d service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:06.080950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d51dc-04ba-4f22-aa7a-0dc2dcca215d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:06.084444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ca2d51dc-04ba-4f22-aa7a-0dc2dcca215d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:06.109859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d51dc-04ba-4f22-aa7a-0dc2dcca215d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:06.111920 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d51dc-04ba-4f22-aa7a-0dc2dcca215d service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:06.126590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1273/2525] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:10:10.840724 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caecba-0aa3-4ec3-a8f1-a9df453ed046 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:10.924727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caecba-0aa3-4ec3-a8f1-a9df453ed046 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:10.929622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:10.931714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:10.931714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:10.931714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] PATH_INFO: `/v3/users/189b77dcaae24f9384d2d4d6fb1d63e4` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:10.933029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=189b77dcaae24f9384d2d4d6fb1d63e4)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:10.935038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:11.141323 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189b77dcaae24f9384d2d4d6fb1d63e4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:11.142905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189b77dcaae24f9384d2d4d6fb1d63e4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:11.226304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189b77dcaae24f9384d2d4d6fb1d63e4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:11.249093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189b77dcaae24f9384d2d4d6fb1d63e4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:11.259876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189b77dcaae24f9384d2d4d6fb1d63e4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:11.267976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1253/2526] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:10:10 2022] DELETE /identity/v3/users/189b77dcaae24f9384d2d4d6fb1d63e4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:11.272871 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f4b3d-e76d-42f4-aa4f-a873e401e0a2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:11.273411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f4b3d-e76d-42f4-aa4f-a873e401e0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:11.273522 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f4b3d-e76d-42f4-aa4f-a873e401e0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:11.307911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-428f4b3d-e76d-42f4-aa4f-a873e401e0a2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:11.309760 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-428f4b3d-e76d-42f4-aa4f-a873e401e0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:11.392043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1274/2527] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:11.402298 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:11.403743 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:11.447414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:11.495938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7f61e-5386-4011-85b5-c8c7c17ebbaa admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:11.499824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464594d4-54ff-45be-a39d-427755e7410c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:11.500463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464594d4-54ff-45be-a39d-427755e7410c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:11.500752 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464594d4-54ff-45be-a39d-427755e7410c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:11.501028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464594d4-54ff-45be-a39d-427755e7410c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:11.511572 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464594d4-54ff-45be-a39d-427755e7410c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:11.519547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464594d4-54ff-45be-a39d-427755e7410c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:11.523570 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1254/2528] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:12.080984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f4b3d-e76d-42f4-aa4f-a873e401e0a2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:12.082801 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-428f4b3d-e76d-42f4-aa4f-a873e401e0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:12.090331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:12.102496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f4b3d-e76d-42f4-aa4f-a873e401e0a2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:12.110939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:12.111823 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:12.112211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:12.112587 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] PATH_INFO: `/v3/projects/f3b8a8c1c4e0425d90c2103bea59756b` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:12.115452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b8a8c1c4e0425d90c2103bea59756b)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:12.117637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:12.240818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b8a8c1c4e0425d90c2103bea59756b', 'request_id': 'req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:12.256819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b8a8c1c4e0425d90c2103bea59756b', 'request_id': 'req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:12.268130 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b8a8c1c4e0425d90c2103bea59756b', 'request_id': 'req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:12.368844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] The token cache is being invalidate because project f3b8a8c1c4e0425d90c2103bea59756b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:10:12.369600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:12.369978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:12.374951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1275/2529] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:10:12 2022] DELETE /identity/v3/projects/f3b8a8c1c4e0425d90c2103bea59756b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:12.375990 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464594d4-54ff-45be-a39d-427755e7410c service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:12.393036 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464594d4-54ff-45be-a39d-427755e7410c service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:12.467749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:12.469407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:12.469966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:12.470402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] PATH_INFO: `/v3/users/fa4178805940458eaccd545f1ac42729` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:12.471993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4178805940458eaccd545f1ac42729)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:12.474027 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:12.747084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4178805940458eaccd545f1ac42729'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:12.747880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4178805940458eaccd545f1ac42729'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:12.849893 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4178805940458eaccd545f1ac42729'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:12.864912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4178805940458eaccd545f1ac42729'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:12.880186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4178805940458eaccd545f1ac42729'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:12.887876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1255/2530] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:10:12 2022] DELETE /identity/v3/users/fa4178805940458eaccd545f1ac42729 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:13.387281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:13.388755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:13.423405 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b099-a3ee-46c7-8b23-2ea19cf63fcf admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:13.506187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:13.506984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:13.507489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:13.507834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] PATH_INFO: `/v3/projects/185fd3704cb642029e5a224e0dc7e796` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:13.509856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185fd3704cb642029e5a224e0dc7e796)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:13.511912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:13.644936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185fd3704cb642029e5a224e0dc7e796', 'request_id': 'req-c2782dde-2b01-4bdd-9aa9-ec43c9947045'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:13.653330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185fd3704cb642029e5a224e0dc7e796', 'request_id': 'req-c2782dde-2b01-4bdd-9aa9-ec43c9947045'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:13.662097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185fd3704cb642029e5a224e0dc7e796', 'request_id': 'req-c2782dde-2b01-4bdd-9aa9-ec43c9947045'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:13.744042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] The token cache is being invalidate because project 185fd3704cb642029e5a224e0dc7e796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:10:13.744856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:13.745111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:13.749190 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1276/2531] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:10:13 2022] DELETE /identity/v3/projects/185fd3704cb642029e5a224e0dc7e796 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:13.752901 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:13.754428 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:13.771818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959467ff-042c-48cc-9776-cfac7aacbe71 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:13.814534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:13.844408 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:13.845071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:13.845390 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:13.845675 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] PATH_INFO: `/v3/users/de394cad1d7d4509ad6bde9b75960626` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:13.846923 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=de394cad1d7d4509ad6bde9b75960626)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:13.851468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:14.054726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de394cad1d7d4509ad6bde9b75960626'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:14.057604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de394cad1d7d4509ad6bde9b75960626'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:14.122502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de394cad1d7d4509ad6bde9b75960626'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:14.141468 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de394cad1d7d4509ad6bde9b75960626'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:14.150107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-fc04c2d8-eba5-4467-a673-ff3b67fab24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de394cad1d7d4509ad6bde9b75960626'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:14.156794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1256/2532] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:10:13 2022] DELETE /identity/v3/users/de394cad1d7d4509ad6bde9b75960626 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:14.675426 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:14.677035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:14.692843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782dde-2b01-4bdd-9aa9-ec43c9947045 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:14.722676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:14.790959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:14.791648 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:14.791912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:14.792325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] PATH_INFO: `/v3/projects/28de5bbb5710443ea19c0d81e7ce2d32` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:14.793529 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28de5bbb5710443ea19c0d81e7ce2d32)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:14.795477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:14.929226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28de5bbb5710443ea19c0d81e7ce2d32', 'request_id': 'req-1f1bb04b-15bc-4723-8889-bbfac517a70c'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:14.936360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28de5bbb5710443ea19c0d81e7ce2d32', 'request_id': 'req-1f1bb04b-15bc-4723-8889-bbfac517a70c'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:14.943012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28de5bbb5710443ea19c0d81e7ce2d32', 'request_id': 'req-1f1bb04b-15bc-4723-8889-bbfac517a70c'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:15.324401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] The token cache is being invalidate because project 28de5bbb5710443ea19c0d81e7ce2d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:10:15.324623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:15.325282 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1f1bb04b-15bc-4723-8889-bbfac517a70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:15.326814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1277/2533] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:10:14 2022] DELETE /identity/v3/projects/28de5bbb5710443ea19c0d81e7ce2d32 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:15.332868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b2b93-cd7d-4c87-89aa-9c16423ba395 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:15.333516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b2b93-cd7d-4c87-89aa-9c16423ba395 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:15.333516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b2b93-cd7d-4c87-89aa-9c16423ba395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:15.388844 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ae6b2b93-cd7d-4c87-89aa-9c16423ba395 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:15.390091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ae6b2b93-cd7d-4c87-89aa-9c16423ba395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:15.460418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1257/2534] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:15.471219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87ddd2-478e-42f4-9f62-98718b6ca5a2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:15.471780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87ddd2-478e-42f4-9f62-98718b6ca5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:15.471780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87ddd2-478e-42f4-9f62-98718b6ca5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:15.494822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0c87ddd2-478e-42f4-9f62-98718b6ca5a2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:15.496175 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0c87ddd2-478e-42f4-9f62-98718b6ca5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:15.504988 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1278/2535] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:15.510885 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b2b93-cd7d-4c87-89aa-9c16423ba395 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:15.522191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b2b93-cd7d-4c87-89aa-9c16423ba395 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:15.528107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795d820-40e3-4d29-b807-7c1798e1aa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:15.528747 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795d820-40e3-4d29-b807-7c1798e1aa34 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:15.529049 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795d820-40e3-4d29-b807-7c1798e1aa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:15.529361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795d820-40e3-4d29-b807-7c1798e1aa34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:15.530077 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795d820-40e3-4d29-b807-7c1798e1aa34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:10:15.530388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795d820-40e3-4d29-b807-7c1798e1aa34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:15.534233 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795d820-40e3-4d29-b807-7c1798e1aa34 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:15.550535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1258/2536] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:10:15.553906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87ddd2-478e-42f4-9f62-98718b6ca5a2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:15.563000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87ddd2-478e-42f4-9f62-98718b6ca5a2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:15.568245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf2730-2568-4192-81eb-8e786537cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:15.568886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf2730-2568-4192-81eb-8e786537cbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:15.569222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf2730-2568-4192-81eb-8e786537cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:15.569646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf2730-2568-4192-81eb-8e786537cbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:15.570337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf2730-2568-4192-81eb-8e786537cbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:15.572729 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf2730-2568-4192-81eb-8e786537cbf3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:15.659809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1279/2537] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:10:15 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:15.663948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795d820-40e3-4d29-b807-7c1798e1aa34 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:15.681138 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795d820-40e3-4d29-b807-7c1798e1aa34 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:15.700939 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:15.754844 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41ca27-f60b-46fa-b05e-e79561bb7425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:15.755637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41ca27-f60b-46fa-b05e-e79561bb7425 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:15.756033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41ca27-f60b-46fa-b05e-e79561bb7425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:15.756429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41ca27-f60b-46fa-b05e-e79561bb7425 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:15.757213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41ca27-f60b-46fa-b05e-e79561bb7425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:15.761470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41ca27-f60b-46fa-b05e-e79561bb7425 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:15.856056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1259/2538] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:10:15 2022] POST /identity/v3/users => generated 281 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:15.858305 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf2730-2568-4192-81eb-8e786537cbf3 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:15.871580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf2730-2568-4192-81eb-8e786537cbf3 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:15.876446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907baea3-2f34-4da2-a1e9-ab07c686b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:15.877219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907baea3-2f34-4da2-a1e9-ab07c686b1af admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:15.877674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907baea3-2f34-4da2-a1e9-ab07c686b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:15.878009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907baea3-2f34-4da2-a1e9-ab07c686b1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:15.878773 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907baea3-2f34-4da2-a1e9-ab07c686b1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:15.880532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907baea3-2f34-4da2-a1e9-ab07c686b1af admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:15.894469 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1280/2539] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:15.896000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41ca27-f60b-46fa-b05e-e79561bb7425 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:15.908099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41ca27-f60b-46fa-b05e-e79561bb7425 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:15.914012 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083147e-acc0-4f86-94cd-96945e63c566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:15.915091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083147e-acc0-4f86-94cd-96945e63c566 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:15.915450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083147e-acc0-4f86-94cd-96945e63c566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:15.915714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083147e-acc0-4f86-94cd-96945e63c566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:15.916453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083147e-acc0-4f86-94cd-96945e63c566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:15.918137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083147e-acc0-4f86-94cd-96945e63c566 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:15.938659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1260/2540] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:15.939965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907baea3-2f34-4da2-a1e9-ab07c686b1af admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:15.950777 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907baea3-2f34-4da2-a1e9-ab07c686b1af admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:15.967630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01abbc3-1f7e-4a53-8f12-caa2632524b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:15.968332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01abbc3-1f7e-4a53-8f12-caa2632524b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:15.968616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01abbc3-1f7e-4a53-8f12-caa2632524b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:15.968895 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01abbc3-1f7e-4a53-8f12-caa2632524b9 admin admin] PATH_INFO: `/v3/projects/cdddb63c06f44247a88b8bb1dfddd411/users/5ed7e81d1aa5416097fe6ed33fa0e426/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:15.997399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01abbc3-1f7e-4a53-8f12-caa2632524b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdddb63c06f44247a88b8bb1dfddd411, user_id=5ed7e81d1aa5416097fe6ed33fa0e426, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:16.001886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01abbc3-1f7e-4a53-8f12-caa2632524b9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:16.139979 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1281/2541] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:10:15 2022] PUT /identity/v3/projects/cdddb63c06f44247a88b8bb1dfddd411/users/5ed7e81d1aa5416097fe6ed33fa0e426/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:16.153396 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714cc19-4a3a-4ec8-bcd7-15a9360dce9b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:16.153708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714cc19-4a3a-4ec8-bcd7-15a9360dce9b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:16.153998 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714cc19-4a3a-4ec8-bcd7-15a9360dce9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:16.183032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f714cc19-4a3a-4ec8-bcd7-15a9360dce9b None None] MFA Rules not processed for user `5ed7e81d1aa5416097fe6ed33fa0e426`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:16.184172 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f714cc19-4a3a-4ec8-bcd7-15a9360dce9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:16.250207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1261/2542] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:16.285487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01abbc3-1f7e-4a53-8f12-caa2632524b9 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:16.287239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c01abbc3-1f7e-4a53-8f12-caa2632524b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:16.334402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:16.347527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01abbc3-1f7e-4a53-8f12-caa2632524b9 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:16.351507 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a79ec-f16f-47c0-a6b4-363d13813f0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:16.352728 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a79ec-f16f-47c0-a6b4-363d13813f0c service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:16.353005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a79ec-f16f-47c0-a6b4-363d13813f0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:16.353314 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a79ec-f16f-47c0-a6b4-363d13813f0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:16.362243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a79ec-f16f-47c0-a6b4-363d13813f0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:16.363712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a79ec-f16f-47c0-a6b4-363d13813f0c service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:16.373636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1282/2543] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:16.388861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714cc19-4a3a-4ec8-bcd7-15a9360dce9b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:16.452301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714cc19-4a3a-4ec8-bcd7-15a9360dce9b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:16.457015 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:16.457720 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:16.458022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:16.458276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] PATH_INFO: `/v3/users/5ed7e81d1aa5416097fe6ed33fa0e426` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:16.459447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed7e81d1aa5416097fe6ed33fa0e426)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:16.461978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:16.548414 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:16.650915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed7e81d1aa5416097fe6ed33fa0e426'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:16.651658 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed7e81d1aa5416097fe6ed33fa0e426'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:16.721988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed7e81d1aa5416097fe6ed33fa0e426'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:16.734268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed7e81d1aa5416097fe6ed33fa0e426'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:16.741043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed7e81d1aa5416097fe6ed33fa0e426'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:16.747203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1262/2544] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:10:16 2022] DELETE /identity/v3/users/5ed7e81d1aa5416097fe6ed33fa0e426 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:16.751758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a199ba-6d42-474d-8ef2-890de21b7107 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:16.752038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a199ba-6d42-474d-8ef2-890de21b7107 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:16.752312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a199ba-6d42-474d-8ef2-890de21b7107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:16.771828 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-02a199ba-6d42-474d-8ef2-890de21b7107 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:16.773031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-02a199ba-6d42-474d-8ef2-890de21b7107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:16.831360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1283/2545] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:16.841047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:16.842509 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:16.902137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556709b-0f29-4560-8b31-3dee6fdee5ef admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:16.905764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83274-511d-47d9-9b2c-3d9838f46429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:16.906383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83274-511d-47d9-9b2c-3d9838f46429 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:16.906663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83274-511d-47d9-9b2c-3d9838f46429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:16.906936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83274-511d-47d9-9b2c-3d9838f46429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:16.916165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df83274-511d-47d9-9b2c-3d9838f46429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:16.917645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df83274-511d-47d9-9b2c-3d9838f46429 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:16.927367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1263/2546] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:17.681787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a199ba-6d42-474d-8ef2-890de21b7107 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:17.685042 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-02a199ba-6d42-474d-8ef2-890de21b7107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:17.698331 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a199ba-6d42-474d-8ef2-890de21b7107 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:17.703806 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:17.704494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:17.704870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:17.705166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] PATH_INFO: `/v3/projects/cdddb63c06f44247a88b8bb1dfddd411` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:17.706435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdddb63c06f44247a88b8bb1dfddd411)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:17.709558 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:17.819135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdddb63c06f44247a88b8bb1dfddd411', 'request_id': 'req-98306030-f2f8-46a7-9bdd-8d2abf9f9446'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:17.826293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdddb63c06f44247a88b8bb1dfddd411', 'request_id': 'req-98306030-f2f8-46a7-9bdd-8d2abf9f9446'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:17.832178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdddb63c06f44247a88b8bb1dfddd411', 'request_id': 'req-98306030-f2f8-46a7-9bdd-8d2abf9f9446'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:17.907110 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] The token cache is being invalidate because project cdddb63c06f44247a88b8bb1dfddd411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:10:17.907410 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:17.908072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-98306030-f2f8-46a7-9bdd-8d2abf9f9446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:17.909869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1284/2547] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:10:17 2022] DELETE /identity/v3/projects/cdddb63c06f44247a88b8bb1dfddd411 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:17.917353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652463a9-840d-4350-acb8-df1e3b34bf0c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:17.917934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652463a9-840d-4350-acb8-df1e3b34bf0c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:17.918247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652463a9-840d-4350-acb8-df1e3b34bf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:17.948197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-652463a9-840d-4350-acb8-df1e3b34bf0c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:17.949637 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-652463a9-840d-4350-acb8-df1e3b34bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:18.015543 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1264/2548] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:18.023643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a95308-9c53-44c7-bca6-860b6e517252 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:18.024003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a95308-9c53-44c7-bca6-860b6e517252 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:18.024357 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a95308-9c53-44c7-bca6-860b6e517252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:18.046907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-24a95308-9c53-44c7-bca6-860b6e517252 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:18.048162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-24a95308-9c53-44c7-bca6-860b6e517252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:18.056747 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1285/2549] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:18.061171 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652463a9-840d-4350-acb8-df1e3b34bf0c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:18.072541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652463a9-840d-4350-acb8-df1e3b34bf0c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:18.077426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9ed2f-b774-4a63-ba2b-4c03eb2b9819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:18.078061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ed2f-b774-4a63-ba2b-4c03eb2b9819 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:18.078485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ed2f-b774-4a63-ba2b-4c03eb2b9819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:18.078770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ed2f-b774-4a63-ba2b-4c03eb2b9819 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:18.079512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9ed2f-b774-4a63-ba2b-4c03eb2b9819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:10:18.079817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9ed2f-b774-4a63-ba2b-4c03eb2b9819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:18.081470 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9ed2f-b774-4a63-ba2b-4c03eb2b9819 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:18.094979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1265/2550] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:10:18.100521 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a95308-9c53-44c7-bca6-860b6e517252 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:18.110374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a95308-9c53-44c7-bca6-860b6e517252 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:18.115027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a487b8-39f6-47cb-bfdc-34202303c528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:18.115640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a487b8-39f6-47cb-bfdc-34202303c528 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:18.115914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a487b8-39f6-47cb-bfdc-34202303c528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:18.116187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a487b8-39f6-47cb-bfdc-34202303c528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:18.116847 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a487b8-39f6-47cb-bfdc-34202303c528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:18.118924 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a487b8-39f6-47cb-bfdc-34202303c528 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:18.247538 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1286/2551] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:10:18 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:18.251877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9ed2f-b774-4a63-ba2b-4c03eb2b9819 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:18.263083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9ed2f-b774-4a63-ba2b-4c03eb2b9819 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:18.297628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:18.325866 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c5b5e-de37-401c-9217-91ee499fbba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:18.326324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c5b5e-de37-401c-9217-91ee499fbba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:18.326615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c5b5e-de37-401c-9217-91ee499fbba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:18.326899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c5b5e-de37-401c-9217-91ee499fbba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:18.327682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c5b5e-de37-401c-9217-91ee499fbba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:18.329681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c5b5e-de37-401c-9217-91ee499fbba6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:18.461837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1266/2552] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:10:18 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:18.466323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a487b8-39f6-47cb-bfdc-34202303c528 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:18.477652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a487b8-39f6-47cb-bfdc-34202303c528 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:18.482636 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0bed0-d457-44ac-a486-402f10e44810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:18.483311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0bed0-d457-44ac-a486-402f10e44810 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:18.486592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0bed0-d457-44ac-a486-402f10e44810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:18.486592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0bed0-d457-44ac-a486-402f10e44810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:18.486592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0bed0-d457-44ac-a486-402f10e44810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:18.486592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0bed0-d457-44ac-a486-402f10e44810 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:18.497941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1287/2553] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:18.502123 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c5b5e-de37-401c-9217-91ee499fbba6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:18.513648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c5b5e-de37-401c-9217-91ee499fbba6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:18.518914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485528ad-65f7-4fe0-b7db-874a72a23009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:18.519635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485528ad-65f7-4fe0-b7db-874a72a23009 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:18.519987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485528ad-65f7-4fe0-b7db-874a72a23009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:18.520336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485528ad-65f7-4fe0-b7db-874a72a23009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:18.521394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485528ad-65f7-4fe0-b7db-874a72a23009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:18.523079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485528ad-65f7-4fe0-b7db-874a72a23009 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:18.534035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1267/2554] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:18.538468 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0bed0-d457-44ac-a486-402f10e44810 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:18.549350 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0bed0-d457-44ac-a486-402f10e44810 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:18.553889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32793c80-eff2-4db3-b4c0-a44c2c7f9bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:18.554547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32793c80-eff2-4db3-b4c0-a44c2c7f9bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:18.555352 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32793c80-eff2-4db3-b4c0-a44c2c7f9bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:18.555802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32793c80-eff2-4db3-b4c0-a44c2c7f9bf6 admin admin] PATH_INFO: `/v3/projects/de23ebba5fb245809c89e4043bb96231/users/6c32092a416e4da2875ffdf50fda3f3c/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:18.571977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32793c80-eff2-4db3-b4c0-a44c2c7f9bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de23ebba5fb245809c89e4043bb96231, user_id=6c32092a416e4da2875ffdf50fda3f3c, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:18.574595 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32793c80-eff2-4db3-b4c0-a44c2c7f9bf6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:18.638780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1288/2555] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:10:18 2022] PUT /identity/v3/projects/de23ebba5fb245809c89e4043bb96231/users/6c32092a416e4da2875ffdf50fda3f3c/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:18.706664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4a71-8cf1-4768-b96e-53eb77e4761e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:18.706980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4a71-8cf1-4768-b96e-53eb77e4761e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:18.707262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4a71-8cf1-4768-b96e-53eb77e4761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:18.737451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0cbf4a71-8cf1-4768-b96e-53eb77e4761e None None] MFA Rules not processed for user `6c32092a416e4da2875ffdf50fda3f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:18.738676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0cbf4a71-8cf1-4768-b96e-53eb77e4761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:18.804359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1268/2556] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:18.816435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32793c80-eff2-4db3-b4c0-a44c2c7f9bf6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:18.818179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-32793c80-eff2-4db3-b4c0-a44c2c7f9bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:18.824911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:18.877090 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32793c80-eff2-4db3-b4c0-a44c2c7f9bf6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:18.880782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ad649-e697-42b8-9f5e-6fe124bb5c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:18.883360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad649-e697-42b8-9f5e-6fe124bb5c22 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:18.883360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad649-e697-42b8-9f5e-6fe124bb5c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:18.883360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad649-e697-42b8-9f5e-6fe124bb5c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:18.891203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ad649-e697-42b8-9f5e-6fe124bb5c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:18.892586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ad649-e697-42b8-9f5e-6fe124bb5c22 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:18.901907 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1289/2557] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:22.056283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf4a71-8cf1-4768-b96e-53eb77e4761e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:22.137204 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf4a71-8cf1-4768-b96e-53eb77e4761e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:22.142139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:22.142760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:22.143059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:22.143326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] PATH_INFO: `/v3/users/6c32092a416e4da2875ffdf50fda3f3c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:22.144534 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c32092a416e4da2875ffdf50fda3f3c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:22.146802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:22.306706 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:22.308235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c32092a416e4da2875ffdf50fda3f3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:22.308947 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c32092a416e4da2875ffdf50fda3f3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:22.380412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c32092a416e4da2875ffdf50fda3f3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:22.393819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c32092a416e4da2875ffdf50fda3f3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:22.401616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c32092a416e4da2875ffdf50fda3f3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:22.407656 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1269/2558] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:10:22 2022] DELETE /identity/v3/users/6c32092a416e4da2875ffdf50fda3f3c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:22.412252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfabc3-9623-46d5-936f-0f707b1f52af None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:22.412740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfabc3-9623-46d5-936f-0f707b1f52af None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:22.412840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfabc3-9623-46d5-936f-0f707b1f52af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:22.434020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-cbbfabc3-9623-46d5-936f-0f707b1f52af None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:22.435390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cbbfabc3-9623-46d5-936f-0f707b1f52af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:22.499654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1290/2559] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:22.510421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:22.511909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:22.571436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a07fc6-6e90-41f4-a94b-5513d885827c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:22.575889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d773-340c-46ff-8883-a11cdd920015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:22.576664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d773-340c-46ff-8883-a11cdd920015 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:22.577089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d773-340c-46ff-8883-a11cdd920015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:22.578808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d773-340c-46ff-8883-a11cdd920015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:22.588352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d773-340c-46ff-8883-a11cdd920015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:22.589871 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d773-340c-46ff-8883-a11cdd920015 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:22.599833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1270/2560] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:23.112922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfabc3-9623-46d5-936f-0f707b1f52af None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:23.114447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cbbfabc3-9623-46d5-936f-0f707b1f52af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:23.137486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfabc3-9623-46d5-936f-0f707b1f52af None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:23.152050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:23.152858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:23.153650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:23.153939 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] PATH_INFO: `/v3/projects/de23ebba5fb245809c89e4043bb96231` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:23.155251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de23ebba5fb245809c89e4043bb96231)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:23.157183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:23.329710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de23ebba5fb245809c89e4043bb96231', 'request_id': 'req-584de582-d74e-4377-abc2-a929b6c86406'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:23.339386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de23ebba5fb245809c89e4043bb96231', 'request_id': 'req-584de582-d74e-4377-abc2-a929b6c86406'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:23.345874 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de23ebba5fb245809c89e4043bb96231', 'request_id': 'req-584de582-d74e-4377-abc2-a929b6c86406'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:23.450409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] The token cache is being invalidate because project de23ebba5fb245809c89e4043bb96231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:10:23.451085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:23.451553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-584de582-d74e-4377-abc2-a929b6c86406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:23.453205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1291/2561] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:10:23 2022] DELETE /identity/v3/projects/de23ebba5fb245809c89e4043bb96231 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:23.458135 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b00b2-02de-4f7b-a4d5-bbb5442c508f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:23.458617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b00b2-02de-4f7b-a4d5-bbb5442c508f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:23.458723 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b00b2-02de-4f7b-a4d5-bbb5442c508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:23.479685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-242b00b2-02de-4f7b-a4d5-bbb5442c508f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:23.480911 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-242b00b2-02de-4f7b-a4d5-bbb5442c508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:23.552545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1271/2562] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:23.561105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1e125-dbb2-4977-9a50-d83bd14c8de3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:23.561418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1e125-dbb2-4977-9a50-d83bd14c8de3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:23.561694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1e125-dbb2-4977-9a50-d83bd14c8de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:23.583013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-93a1e125-dbb2-4977-9a50-d83bd14c8de3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:23.584528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-93a1e125-dbb2-4977-9a50-d83bd14c8de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:23.592775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1292/2563] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:23.597343 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b00b2-02de-4f7b-a4d5-bbb5442c508f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:23.605727 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1e125-dbb2-4977-9a50-d83bd14c8de3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:23.607107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-93a1e125-dbb2-4977-9a50-d83bd14c8de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:23.608908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b00b2-02de-4f7b-a4d5-bbb5442c508f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:23.613674 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462bab5-0d4f-4322-9e72-abafbc35202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:23.614306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462bab5-0d4f-4322-9e72-abafbc35202a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:23.614581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462bab5-0d4f-4322-9e72-abafbc35202a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:23.614857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462bab5-0d4f-4322-9e72-abafbc35202a admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:23.615554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462bab5-0d4f-4322-9e72-abafbc35202a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:10:23.615860 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462bab5-0d4f-4322-9e72-abafbc35202a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:23.618291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462bab5-0d4f-4322-9e72-abafbc35202a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:23.630707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1272/2564] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:10:23.639047 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:23.640395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462bab5-0d4f-4322-9e72-abafbc35202a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:23.653227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462bab5-0d4f-4322-9e72-abafbc35202a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:23.656058 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28b0f9-6e7b-4895-805e-a848d047a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:23.656680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28b0f9-6e7b-4895-805e-a848d047a3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:23.656960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28b0f9-6e7b-4895-805e-a848d047a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:23.657273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28b0f9-6e7b-4895-805e-a848d047a3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:23.657946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28b0f9-6e7b-4895-805e-a848d047a3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:23.659916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28b0f9-6e7b-4895-805e-a848d047a3a6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:23.685961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1e125-dbb2-4977-9a50-d83bd14c8de3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:23.691056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342e820-56d8-4293-ab66-397ab948ed8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:23.691683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342e820-56d8-4293-ab66-397ab948ed8d service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:23.691967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342e820-56d8-4293-ab66-397ab948ed8d service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:23.692243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342e820-56d8-4293-ab66-397ab948ed8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:23.694058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c342e820-56d8-4293-ab66-397ab948ed8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:23.707591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342e820-56d8-4293-ab66-397ab948ed8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:23.709242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342e820-56d8-4293-ab66-397ab948ed8d service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:23.719303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1293/2565] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:10:23.771393 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1273/2566] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:10:23 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:23.775582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342e820-56d8-4293-ab66-397ab948ed8d service placement] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:23.787662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342e820-56d8-4293-ab66-397ab948ed8d service placement] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:23.850995 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03925b83-aba3-4f29-9979-8c8969c83a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:23.851660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03925b83-aba3-4f29-9979-8c8969c83a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:23.851976 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03925b83-aba3-4f29-9979-8c8969c83a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:23.852214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03925b83-aba3-4f29-9979-8c8969c83a44 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:23.853048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03925b83-aba3-4f29-9979-8c8969c83a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:23.858901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03925b83-aba3-4f29-9979-8c8969c83a44 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:23.970459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1294/2567] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:10:23 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:23.974621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28b0f9-6e7b-4895-805e-a848d047a3a6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:23.987081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28b0f9-6e7b-4895-805e-a848d047a3a6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:23.993955 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088f9a8-9c35-457a-8a30-1d6214294209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:23.994895 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088f9a8-9c35-457a-8a30-1d6214294209 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:23.995366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088f9a8-9c35-457a-8a30-1d6214294209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:23.995785 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088f9a8-9c35-457a-8a30-1d6214294209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:23.996710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088f9a8-9c35-457a-8a30-1d6214294209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:23.999009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088f9a8-9c35-457a-8a30-1d6214294209 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:24.010360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1274/2568] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:24.014886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03925b83-aba3-4f29-9979-8c8969c83a44 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:24.025454 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03925b83-aba3-4f29-9979-8c8969c83a44 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:24.030134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c1f73-3652-4936-a777-4ca16d0aebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:24.030737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1f73-3652-4936-a777-4ca16d0aebab admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:24.031021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1f73-3652-4936-a777-4ca16d0aebab admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:24.031289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1f73-3652-4936-a777-4ca16d0aebab admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:24.031977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c1f73-3652-4936-a777-4ca16d0aebab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:24.033608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c1f73-3652-4936-a777-4ca16d0aebab admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:24.044387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1295/2569] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:24.048702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088f9a8-9c35-457a-8a30-1d6214294209 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:24.059633 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088f9a8-9c35-457a-8a30-1d6214294209 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:24.064368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402309f2-acdf-4e02-a42a-969b28c6daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:24.065019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402309f2-acdf-4e02-a42a-969b28c6daec admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:24.065331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402309f2-acdf-4e02-a42a-969b28c6daec admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:24.065623 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402309f2-acdf-4e02-a42a-969b28c6daec admin admin] PATH_INFO: `/v3/projects/5294a27d013a4e8ebf3edb976cd1be5f/users/cfeb83b615b3423aac5ee2c870b5edcd/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:24.084194 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402309f2-acdf-4e02-a42a-969b28c6daec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5294a27d013a4e8ebf3edb976cd1be5f, user_id=cfeb83b615b3423aac5ee2c870b5edcd, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:24.087816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402309f2-acdf-4e02-a42a-969b28c6daec admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:24.091446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:24.184227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1275/2570] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:10:24 2022] PUT /identity/v3/projects/5294a27d013a4e8ebf3edb976cd1be5f/users/cfeb83b615b3423aac5ee2c870b5edcd/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:24.185554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8c669-fa7b-4ea7-b00d-b4bc8906f130 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:24.185946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8c669-fa7b-4ea7-b00d-b4bc8906f130 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:24.186223 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8c669-fa7b-4ea7-b00d-b4bc8906f130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:24.217566 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-53c8c669-fa7b-4ea7-b00d-b4bc8906f130 None None] MFA Rules not processed for user `cfeb83b615b3423aac5ee2c870b5edcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:24.218799 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-53c8c669-fa7b-4ea7-b00d-b4bc8906f130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:24.293644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1296/2571] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:24.305075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402309f2-acdf-4e02-a42a-969b28c6daec admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:24.306774 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-402309f2-acdf-4e02-a42a-969b28c6daec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:24.382535 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402309f2-acdf-4e02-a42a-969b28c6daec admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:24.386648 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674502-cbaa-4066-b206-5bcd36b08b02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:24.387272 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674502-cbaa-4066-b206-5bcd36b08b02 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:24.387551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674502-cbaa-4066-b206-5bcd36b08b02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:24.387876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674502-cbaa-4066-b206-5bcd36b08b02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:24.397424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa674502-cbaa-4066-b206-5bcd36b08b02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:24.399936 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa674502-cbaa-4066-b206-5bcd36b08b02 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:24.409372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1276/2572] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:26.571480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6ae0-90c5-4b63-89fc-b905c6f5ad67 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:26.571928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6ae0-90c5-4b63-89fc-b905c6f5ad67 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:26.572024 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6ae0-90c5-4b63-89fc-b905c6f5ad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:26.593631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-02fa6ae0-90c5-4b63-89fc-b905c6f5ad67 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:26.594891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-02fa6ae0-90c5-4b63-89fc-b905c6f5ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:26.612873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:26.651557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1297/2573] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:10:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:26.663359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674502-cbaa-4066-b206-5bcd36b08b02 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:26.665641 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-aa674502-cbaa-4066-b206-5bcd36b08b02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:26.740340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674502-cbaa-4066-b206-5bcd36b08b02 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:26.745678 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3e188-f603-4676-b383-ff2a34af94a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:26.746332 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e188-f603-4676-b383-ff2a34af94a6 service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:26.746617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e188-f603-4676-b383-ff2a34af94a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:26.746900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e188-f603-4676-b383-ff2a34af94a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:26.756427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3e188-f603-4676-b383-ff2a34af94a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:26.758153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3e188-f603-4676-b383-ff2a34af94a6 service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:26.767168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1277/2574] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:10:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:10:36.587647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa6ae0-90c5-4b63-89fc-b905c6f5ad67 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:36.667094 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa6ae0-90c5-4b63-89fc-b905c6f5ad67 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:36.673580 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:36.674183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:36.674459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:36.674732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] PATH_INFO: `/v3/users/cfeb83b615b3423aac5ee2c870b5edcd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:36.675942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfeb83b615b3423aac5ee2c870b5edcd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:36.677941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:36.763448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=60 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:36.874245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfeb83b615b3423aac5ee2c870b5edcd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:36.880902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfeb83b615b3423aac5ee2c870b5edcd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:36.952459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfeb83b615b3423aac5ee2c870b5edcd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:36.953079 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfeb83b615b3423aac5ee2c870b5edcd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:36.953708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfeb83b615b3423aac5ee2c870b5edcd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:36.974485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1298/2575] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:10:36 2022] DELETE /identity/v3/users/cfeb83b615b3423aac5ee2c870b5edcd => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:36.979503 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa06b66-6e5c-4224-bbf3-11eb490cc8fe None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:36.984851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa06b66-6e5c-4224-bbf3-11eb490cc8fe None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:36.984851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa06b66-6e5c-4224-bbf3-11eb490cc8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:36.999679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-dfa06b66-6e5c-4224-bbf3-11eb490cc8fe None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:37.000898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-dfa06b66-6e5c-4224-bbf3-11eb490cc8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:37.062980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1278/2576] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:37.073530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:37.075435 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:37.127950 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:37.135904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9e7d-b1d4-4152-971b-d2a4ad011cf3 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:37.139583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0a160-4ade-4350-a9e4-84db48c72c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:37.140183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a160-4ade-4350-a9e4-84db48c72c89 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:37.140464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a160-4ade-4350-a9e4-84db48c72c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:37.140737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a160-4ade-4350-a9e4-84db48c72c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:37.150365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0a160-4ade-4350-a9e4-84db48c72c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:37.151800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0a160-4ade-4350-a9e4-84db48c72c89 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:37.161614 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1299/2577] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:37.561160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa06b66-6e5c-4224-bbf3-11eb490cc8fe None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:37.562907 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-dfa06b66-6e5c-4224-bbf3-11eb490cc8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:37.582124 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa06b66-6e5c-4224-bbf3-11eb490cc8fe None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:37.590976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:37.591683 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:37.591991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:37.592265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] PATH_INFO: `/v3/projects/5294a27d013a4e8ebf3edb976cd1be5f` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:37.593550 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5294a27d013a4e8ebf3edb976cd1be5f)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:37.596222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:37.777903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5294a27d013a4e8ebf3edb976cd1be5f', 'request_id': 'req-39972e0e-739b-4b41-800c-915ae386f3ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:37.786024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5294a27d013a4e8ebf3edb976cd1be5f', 'request_id': 'req-39972e0e-739b-4b41-800c-915ae386f3ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:37.866432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5294a27d013a4e8ebf3edb976cd1be5f', 'request_id': 'req-39972e0e-739b-4b41-800c-915ae386f3ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:37.879305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] The token cache is being invalidate because project 5294a27d013a4e8ebf3edb976cd1be5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:10:37.879635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:37.880270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:37.897766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1279/2578] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:10:37 2022] DELETE /identity/v3/projects/5294a27d013a4e8ebf3edb976cd1be5f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:10:42.542757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff1996-16cd-407b-b15f-47340376fdd8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:42.543292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff1996-16cd-407b-b15f-47340376fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:42.543292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff1996-16cd-407b-b15f-47340376fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:42.562610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5cff1996-16cd-407b-b15f-47340376fdd8 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:42.563826 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5cff1996-16cd-407b-b15f-47340376fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:42.620400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1300/2579] 10.222.0.55 () {58 vars in 967 bytes} [Mon Jul 25 23:10:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:42.633235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:42.634791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:42.720449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39972e0e-739b-4b41-800c-915ae386f3ae admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:42.726153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcdd3a-b996-45b8-9ad0-a97de89a6d77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:42.726954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcdd3a-b996-45b8-9ad0-a97de89a6d77 service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:42.727283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcdd3a-b996-45b8-9ad0-a97de89a6d77 service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:42.727510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcdd3a-b996-45b8-9ad0-a97de89a6d77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:42.736603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcdd3a-b996-45b8-9ad0-a97de89a6d77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:42.738327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcdd3a-b996-45b8-9ad0-a97de89a6d77 service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:42.750326 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1280/2580] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:10:45.951770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff1996-16cd-407b-b15f-47340376fdd8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:45.953303 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5cff1996-16cd-407b-b15f-47340376fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:46.009962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff1996-16cd-407b-b15f-47340376fdd8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:46.013542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b924f0-1602-4530-a69a-4650cec21ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:46.014161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b924f0-1602-4530-a69a-4650cec21ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:46.014440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b924f0-1602-4530-a69a-4650cec21ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:46.014711 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b924f0-1602-4530-a69a-4650cec21ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:46.016467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a2b924f0-1602-4530-a69a-4650cec21ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:46.086649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b924f0-1602-4530-a69a-4650cec21ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:46.088110 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b924f0-1602-4530-a69a-4650cec21ce1 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:46.098778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1301/2581] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:49.858105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcdd3a-b996-45b8-9ad0-a97de89a6d77 service swift] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:49.858105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d4fcdd3a-b996-45b8-9ad0-a97de89a6d77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:49.871082 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcdd3a-b996-45b8-9ad0-a97de89a6d77 service swift] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:49.875899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:49.876544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:49.876887 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:49.877108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] PATH_INFO: `/v3/users/4eea5a29c87d431299b220e404fd5732` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:49.878370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eea5a29c87d431299b220e404fd5732)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:49.880437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:49.887506 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:50.090358 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eea5a29c87d431299b220e404fd5732'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:50.091045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eea5a29c87d431299b220e404fd5732'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:50.150490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eea5a29c87d431299b220e404fd5732'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:50.164063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eea5a29c87d431299b220e404fd5732'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:50.170993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea3476f6-d531-4ae6-a9b7-96d02ac7e5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eea5a29c87d431299b220e404fd5732'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:50.176977 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1281/2582] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:10:49 2022] DELETE /identity/v3/users/4eea5a29c87d431299b220e404fd5732 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:50.445032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b924f0-1602-4530-a69a-4650cec21ce1 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:50.455379 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b924f0-1602-4530-a69a-4650cec21ce1 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:50.499932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:50.514421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:50.514992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:50.515272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:50.515548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] PATH_INFO: `/v3/projects/f0c3fc0630dd4083bcc8a9f70af99463` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:50.516713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c3fc0630dd4083bcc8a9f70af99463)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:50.518663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:50.667621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c3fc0630dd4083bcc8a9f70af99463', 'request_id': 'req-9aa58134-935c-4a71-82f5-91fe9b4ede10'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:50.677842 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c3fc0630dd4083bcc8a9f70af99463', 'request_id': 'req-9aa58134-935c-4a71-82f5-91fe9b4ede10'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:50.686291 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c3fc0630dd4083bcc8a9f70af99463', 'request_id': 'req-9aa58134-935c-4a71-82f5-91fe9b4ede10'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:50.767260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] The token cache is being invalidate because project f0c3fc0630dd4083bcc8a9f70af99463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:10:50.767582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:50.768242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9aa58134-935c-4a71-82f5-91fe9b4ede10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:10:50.769870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1302/2583] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:10:50 2022] DELETE /identity/v3/projects/f0c3fc0630dd4083bcc8a9f70af99463 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:10:50.775748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ded5e-cf4c-4982-b53a-012f27479d71 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:50.776025 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ded5e-cf4c-4982-b53a-012f27479d71 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:50.776306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ded5e-cf4c-4982-b53a-012f27479d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:50.801361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-135ded5e-cf4c-4982-b53a-012f27479d71 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:50.802586 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-135ded5e-cf4c-4982-b53a-012f27479d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:50.865350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1282/2584] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:50.873145 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba44e1-c698-454b-979f-481b9be51a4f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:50.873437 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba44e1-c698-454b-979f-481b9be51a4f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:50.873717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba44e1-c698-454b-979f-481b9be51a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:50.894377 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-03ba44e1-c698-454b-979f-481b9be51a4f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:50.895922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-03ba44e1-c698-454b-979f-481b9be51a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:50.905414 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1303/2585] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:50.909711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ded5e-cf4c-4982-b53a-012f27479d71 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:50.920898 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ded5e-cf4c-4982-b53a-012f27479d71 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:50.925369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e6ba-28a8-4c73-b976-76e2367185e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:50.925972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e6ba-28a8-4c73-b976-76e2367185e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:50.926249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e6ba-28a8-4c73-b976-76e2367185e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:50.926519 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e6ba-28a8-4c73-b976-76e2367185e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:50.927205 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90e6ba-28a8-4c73-b976-76e2367185e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:10:50.927505 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90e6ba-28a8-4c73-b976-76e2367185e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:50.929732 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90e6ba-28a8-4c73-b976-76e2367185e6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:50.941185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1283/2586] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:10:50.946274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba44e1-c698-454b-979f-481b9be51a4f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:50.955858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba44e1-c698-454b-979f-481b9be51a4f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:50.961082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8519c02-89ff-4519-bbf6-d12efdbe164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:50.961798 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8519c02-89ff-4519-bbf6-d12efdbe164f admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:50.962080 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8519c02-89ff-4519-bbf6-d12efdbe164f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:50.962353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8519c02-89ff-4519-bbf6-d12efdbe164f admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:50.963020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8519c02-89ff-4519-bbf6-d12efdbe164f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:50.964916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8519c02-89ff-4519-bbf6-d12efdbe164f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:51.048795 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1304/2587] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:10:50 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:51.052797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e6ba-28a8-4c73-b976-76e2367185e6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:51.063052 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e6ba-28a8-4c73-b976-76e2367185e6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:51.119274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f3e42-cac7-4e0f-be18-d83d3d128062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:51.119882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f3e42-cac7-4e0f-be18-d83d3d128062 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:51.120165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f3e42-cac7-4e0f-be18-d83d3d128062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:51.120443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f3e42-cac7-4e0f-be18-d83d3d128062 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:51.121114 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f3e42-cac7-4e0f-be18-d83d3d128062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:51.123066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f3e42-cac7-4e0f-be18-d83d3d128062 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:51.203303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1284/2588] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:10:51 2022] POST /identity/v3/users => generated 282 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:51.207296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8519c02-89ff-4519-bbf6-d12efdbe164f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:51.218776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8519c02-89ff-4519-bbf6-d12efdbe164f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:51.223450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e628b8d-2d3f-4ff2-8c11-d661cf29f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:51.224099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e628b8d-2d3f-4ff2-8c11-d661cf29f7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:51.224381 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e628b8d-2d3f-4ff2-8c11-d661cf29f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:51.224657 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e628b8d-2d3f-4ff2-8c11-d661cf29f7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:51.225419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e628b8d-2d3f-4ff2-8c11-d661cf29f7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:51.227029 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e628b8d-2d3f-4ff2-8c11-d661cf29f7b8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:51.237462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1305/2589] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:51.241511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f3e42-cac7-4e0f-be18-d83d3d128062 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:51.247226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:51.252809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f3e42-cac7-4e0f-be18-d83d3d128062 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:51.258283 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21a08-3a8c-496f-9aa8-02880d5871da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:51.258883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21a08-3a8c-496f-9aa8-02880d5871da admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:51.259165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21a08-3a8c-496f-9aa8-02880d5871da admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:51.259440 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21a08-3a8c-496f-9aa8-02880d5871da admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:51.260129 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb21a08-3a8c-496f-9aa8-02880d5871da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:51.261751 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb21a08-3a8c-496f-9aa8-02880d5871da admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:51.273248 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1285/2590] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:51.279459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e628b8d-2d3f-4ff2-8c11-d661cf29f7b8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:51.287949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e628b8d-2d3f-4ff2-8c11-d661cf29f7b8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:51.292933 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4609b1-c0e4-4eeb-bdbd-33c9c75e5075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:51.293652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4609b1-c0e4-4eeb-bdbd-33c9c75e5075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:51.294046 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4609b1-c0e4-4eeb-bdbd-33c9c75e5075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:51.294328 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4609b1-c0e4-4eeb-bdbd-33c9c75e5075 admin admin] PATH_INFO: `/v3/projects/9091d3b6acb44d56a783b7582678b5b2/users/c6bf8f9b6a8741a382b12087f230954d/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:51.309573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4609b1-c0e4-4eeb-bdbd-33c9c75e5075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9091d3b6acb44d56a783b7582678b5b2, user_id=c6bf8f9b6a8741a382b12087f230954d, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:51.312402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4609b1-c0e4-4eeb-bdbd-33c9c75e5075 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:51.392672 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1306/2591] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:10:51 2022] PUT /identity/v3/projects/9091d3b6acb44d56a783b7582678b5b2/users/c6bf8f9b6a8741a382b12087f230954d/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:51.404400 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f349a-68bd-4452-b3cb-387f855e0d36 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:51.408628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f349a-68bd-4452-b3cb-387f855e0d36 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:51.408628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f349a-68bd-4452-b3cb-387f855e0d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:51.432989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9c4f349a-68bd-4452-b3cb-387f855e0d36 None None] MFA Rules not processed for user `c6bf8f9b6a8741a382b12087f230954d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:51.434249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9c4f349a-68bd-4452-b3cb-387f855e0d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:51.505429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1286/2592] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:10:51.510500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4609b1-c0e4-4eeb-bdbd-33c9c75e5075 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:51.574919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4609b1-c0e4-4eeb-bdbd-33c9c75e5075 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:51.579800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2568071-3f80-430e-8d39-0f4403b7b405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:51.580436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568071-3f80-430e-8d39-0f4403b7b405 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:51.580717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568071-3f80-430e-8d39-0f4403b7b405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:51.580993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568071-3f80-430e-8d39-0f4403b7b405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:51.581712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2568071-3f80-430e-8d39-0f4403b7b405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:51.583632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2568071-3f80-430e-8d39-0f4403b7b405 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:51.603557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:51.673999 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1307/2593] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:10:51 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:10:51.678434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f349a-68bd-4452-b3cb-387f855e0d36 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:51.690900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f349a-68bd-4452-b3cb-387f855e0d36 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:51.750703 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1fc8a-868e-4fcd-ad71-efd39dab18a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:51.751364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1fc8a-868e-4fcd-ad71-efd39dab18a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:51.751643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1fc8a-868e-4fcd-ad71-efd39dab18a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:51.751918 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1fc8a-868e-4fcd-ad71-efd39dab18a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:51.752580 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1fc8a-868e-4fcd-ad71-efd39dab18a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:51.754839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1fc8a-868e-4fcd-ad71-efd39dab18a0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:51.836828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1287/2594] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:10:51 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:10:51.840916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2568071-3f80-430e-8d39-0f4403b7b405 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:51.852612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2568071-3f80-430e-8d39-0f4403b7b405 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:51.859057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59ed00-399f-4f7e-b574-5294ad5b6250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:51.859689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59ed00-399f-4f7e-b574-5294ad5b6250 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:51.859972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59ed00-399f-4f7e-b574-5294ad5b6250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:51.860244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59ed00-399f-4f7e-b574-5294ad5b6250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:51.861339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59ed00-399f-4f7e-b574-5294ad5b6250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:51.862937 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59ed00-399f-4f7e-b574-5294ad5b6250 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:51.874859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1308/2595] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:51.879149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1fc8a-868e-4fcd-ad71-efd39dab18a0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:51.889582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1fc8a-868e-4fcd-ad71-efd39dab18a0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:51.894294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dc7b0-4ad5-45e1-aeb8-c78e2f4cd8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:51.894954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc7b0-4ad5-45e1-aeb8-c78e2f4cd8af admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:51.895491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc7b0-4ad5-45e1-aeb8-c78e2f4cd8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:51.895772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc7b0-4ad5-45e1-aeb8-c78e2f4cd8af admin admin] PATH_INFO: `/v3/projects/f72fce52085141fcb858cd9d4e0fba6e/users/2ee32990a8b44c208b5330371116c67f/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:51.911182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dc7b0-4ad5-45e1-aeb8-c78e2f4cd8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72fce52085141fcb858cd9d4e0fba6e, user_id=2ee32990a8b44c208b5330371116c67f, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:51.914476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dc7b0-4ad5-45e1-aeb8-c78e2f4cd8af admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:52.015597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1288/2596] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:10:51 2022] PUT /identity/v3/projects/f72fce52085141fcb858cd9d4e0fba6e/users/2ee32990a8b44c208b5330371116c67f/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:52.019574 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59ed00-399f-4f7e-b574-5294ad5b6250 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:52.030834 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59ed00-399f-4f7e-b574-5294ad5b6250 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:52.088288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bdf1e-a5a1-4adf-a6c2-5fc00e49dc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:52.088923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bdf1e-a5a1-4adf-a6c2-5fc00e49dc67 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:52.089288 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bdf1e-a5a1-4adf-a6c2-5fc00e49dc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:52.089637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bdf1e-a5a1-4adf-a6c2-5fc00e49dc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:52.090411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bdf1e-a5a1-4adf-a6c2-5fc00e49dc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:52.092072 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bdf1e-a5a1-4adf-a6c2-5fc00e49dc67 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:52.102761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1309/2597] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:10:52.107071 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dc7b0-4ad5-45e1-aeb8-c78e2f4cd8af admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:52.117742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dc7b0-4ad5-45e1-aeb8-c78e2f4cd8af admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:52.122347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd5d31-2240-4e22-b6dc-4e51b489e442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:52.123024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd5d31-2240-4e22-b6dc-4e51b489e442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:52.123295 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd5d31-2240-4e22-b6dc-4e51b489e442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:52.123575 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd5d31-2240-4e22-b6dc-4e51b489e442 admin admin] PATH_INFO: `/v3/projects/f72fce52085141fcb858cd9d4e0fba6e/users/2ee32990a8b44c208b5330371116c67f/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:52.125606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd5d31-2240-4e22-b6dc-4e51b489e442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72fce52085141fcb858cd9d4e0fba6e, user_id=2ee32990a8b44c208b5330371116c67f, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:52.128252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd5d31-2240-4e22-b6dc-4e51b489e442 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:52.138816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1289/2598] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:10:52 2022] PUT /identity/v3/projects/f72fce52085141fcb858cd9d4e0fba6e/users/2ee32990a8b44c208b5330371116c67f/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:10:52.150020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c2f00-27ca-4a87-abd0-5985cda2d3db None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:52.150302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c2f00-27ca-4a87-abd0-5985cda2d3db None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:52.150615 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c2f00-27ca-4a87-abd0-5985cda2d3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:52.179590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-173c2f00-27ca-4a87-abd0-5985cda2d3db None None] MFA Rules not processed for user `2ee32990a8b44c208b5330371116c67f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:10:52.180857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-173c2f00-27ca-4a87-abd0-5985cda2d3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:52.250302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1310/2599] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:10:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:10:52.262408 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd5d31-2240-4e22-b6dc-4e51b489e442 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:52.263619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6dcd5d31-2240-4e22-b6dc-4e51b489e442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:10:52.300883 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:52.324209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd5d31-2240-4e22-b6dc-4e51b489e442 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:52.327218 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ffd0-9e97-43eb-81b9-37cb83771a62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:52.327827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ffd0-9e97-43eb-81b9-37cb83771a62 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:52.328111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ffd0-9e97-43eb-81b9-37cb83771a62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:52.328418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ffd0-9e97-43eb-81b9-37cb83771a62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:52.339306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1ffd0-9e97-43eb-81b9-37cb83771a62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:52.340845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1ffd0-9e97-43eb-81b9-37cb83771a62 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:52.351988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1290/2600] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:10:52.547161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c2f00-27ca-4a87-abd0-5985cda2d3db None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:10:52.557906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c2f00-27ca-4a87-abd0-5985cda2d3db None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:10:52.561662 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4f3cc-71b7-4669-9974-303056d359e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:10:52.562301 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4f3cc-71b7-4669-9974-303056d359e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:10:52.562585 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4f3cc-71b7-4669-9974-303056d359e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:10:52.562857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4f3cc-71b7-4669-9974-303056d359e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:10:52.620869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4f3cc-71b7-4669-9974-303056d359e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:10:52.622342 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4f3cc-71b7-4669-9974-303056d359e0 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:10:52.631138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1311/2601] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:10:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:02.401076 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=11 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:02.627208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:04.589511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ffd0-9e97-43eb-81b9-37cb83771a62 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:04.653066 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ffd0-9e97-43eb-81b9-37cb83771a62 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:04.657679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:04.658314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:04.658605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:04.658877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] PATH_INFO: `/v3/users/c6bf8f9b6a8741a382b12087f230954d` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:04.660028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bf8f9b6a8741a382b12087f230954d)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:04.661996 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:04.852405 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bf8f9b6a8741a382b12087f230954d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:04.853098 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bf8f9b6a8741a382b12087f230954d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:04.929092 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bf8f9b6a8741a382b12087f230954d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:04.941806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bf8f9b6a8741a382b12087f230954d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:04.948686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bf8f9b6a8741a382b12087f230954d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:04.954662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1291/2602] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:11:04 2022] DELETE /identity/v3/users/c6bf8f9b6a8741a382b12087f230954d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:04.959252 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3c002-64eb-4696-a9ed-deb6e438a7b9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:04.959716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3c002-64eb-4696-a9ed-deb6e438a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:04.959811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3c002-64eb-4696-a9ed-deb6e438a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:04.979850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-36f3c002-64eb-4696-a9ed-deb6e438a7b9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:04.981076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-36f3c002-64eb-4696-a9ed-deb6e438a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:05.038941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1312/2603] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:05.048953 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:05.050518 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:05.107908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889c122-100f-4771-a38c-2817a780183e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:05.111442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fc01a-71a9-4413-80ea-faf94b6cf6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:05.112051 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fc01a-71a9-4413-80ea-faf94b6cf6dd service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:05.112329 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fc01a-71a9-4413-80ea-faf94b6cf6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:05.112628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fc01a-71a9-4413-80ea-faf94b6cf6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:05.121979 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fc01a-71a9-4413-80ea-faf94b6cf6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:05.123417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fc01a-71a9-4413-80ea-faf94b6cf6dd service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:05.133485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1292/2604] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:05.542243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3c002-64eb-4696-a9ed-deb6e438a7b9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:05.543656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-36f3c002-64eb-4696-a9ed-deb6e438a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:05.559741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3c002-64eb-4696-a9ed-deb6e438a7b9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:05.564588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:05.566502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:05.566938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:05.567043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] PATH_INFO: `/v3/projects/9091d3b6acb44d56a783b7582678b5b2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:05.568279 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9091d3b6acb44d56a783b7582678b5b2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:05.571494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:05.671745 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9091d3b6acb44d56a783b7582678b5b2', 'request_id': 'req-1308a881-8999-46a5-9537-8265415d3d45'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:05.677912 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9091d3b6acb44d56a783b7582678b5b2', 'request_id': 'req-1308a881-8999-46a5-9537-8265415d3d45'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:05.684249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9091d3b6acb44d56a783b7582678b5b2', 'request_id': 'req-1308a881-8999-46a5-9537-8265415d3d45'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:05.763568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] The token cache is being invalidate because project 9091d3b6acb44d56a783b7582678b5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:11:05.763861 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:05.764488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:05.766067 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1313/2605] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:11:05 2022] DELETE /identity/v3/projects/9091d3b6acb44d56a783b7582678b5b2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:05.770356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fc01a-71a9-4413-80ea-faf94b6cf6dd service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:05.780492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fc01a-71a9-4413-80ea-faf94b6cf6dd service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:05.799557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:05.838365 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:05.839024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:05.839304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:05.839573 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] PATH_INFO: `/v3/users/2ee32990a8b44c208b5330371116c67f` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:05.840741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee32990a8b44c208b5330371116c67f)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:05.842742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:06.010726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee32990a8b44c208b5330371116c67f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:06.011302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee32990a8b44c208b5330371116c67f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:06.060293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee32990a8b44c208b5330371116c67f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:06.072966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee32990a8b44c208b5330371116c67f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:06.079857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d1f4874-f57f-4168-8157-70d85c140eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee32990a8b44c208b5330371116c67f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:06.086214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1293/2606] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:11:05 2022] DELETE /identity/v3/users/2ee32990a8b44c208b5330371116c67f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:06.521740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:06.521740 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:06.536135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308a881-8999-46a5-9537-8265415d3d45 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:06.594200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:06.594844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:06.595123 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:06.595394 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] PATH_INFO: `/v3/projects/f72fce52085141fcb858cd9d4e0fba6e` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:06.596591 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72fce52085141fcb858cd9d4e0fba6e)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:06.598518 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:06.707821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:06.724558 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72fce52085141fcb858cd9d4e0fba6e', 'request_id': 'req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:06.731495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72fce52085141fcb858cd9d4e0fba6e', 'request_id': 'req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:06.736894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72fce52085141fcb858cd9d4e0fba6e', 'request_id': 'req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:06.803098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] The token cache is being invalidate because project f72fce52085141fcb858cd9d4e0fba6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:11:06.803584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:06.803945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8d7c1d75-394b-41fe-8f31-b01fdf25eb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:06.806104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1314/2607] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:11:06 2022] DELETE /identity/v3/projects/f72fce52085141fcb858cd9d4e0fba6e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:06.811028 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a539e-803f-4c68-9848-9f26ea0bd32a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:06.811544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a539e-803f-4c68-9848-9f26ea0bd32a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:06.811644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a539e-803f-4c68-9848-9f26ea0bd32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:06.831759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-274a539e-803f-4c68-9848-9f26ea0bd32a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:06.832967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-274a539e-803f-4c68-9848-9f26ea0bd32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:06.892934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1294/2608] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:06.902766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8097aa-d8db-4ecd-aa8b-3c042df48df7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:06.903054 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8097aa-d8db-4ecd-aa8b-3c042df48df7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:06.903330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8097aa-d8db-4ecd-aa8b-3c042df48df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:06.923248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9a8097aa-d8db-4ecd-aa8b-3c042df48df7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:06.924517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9a8097aa-d8db-4ecd-aa8b-3c042df48df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:06.935877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1315/2609] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:06.940157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a539e-803f-4c68-9848-9f26ea0bd32a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:06.950907 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a539e-803f-4c68-9848-9f26ea0bd32a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:06.955480 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7feb82-7a65-489e-ac84-96999321ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:06.956091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7feb82-7a65-489e-ac84-96999321ecec admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:06.956368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7feb82-7a65-489e-ac84-96999321ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:06.956656 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7feb82-7a65-489e-ac84-96999321ecec admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:06.957366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7feb82-7a65-489e-ac84-96999321ecec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:11:06.957692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7feb82-7a65-489e-ac84-96999321ecec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:06.959321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7feb82-7a65-489e-ac84-96999321ecec admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:06.971673 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1295/2610] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:11:06.976104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8097aa-d8db-4ecd-aa8b-3c042df48df7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:06.986003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8097aa-d8db-4ecd-aa8b-3c042df48df7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:06.990764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bd83d-f9db-404b-89cc-0970c1e0d3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:06.991378 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bd83d-f9db-404b-89cc-0970c1e0d3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:06.991661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bd83d-f9db-404b-89cc-0970c1e0d3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:06.992612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bd83d-f9db-404b-89cc-0970c1e0d3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:06.993317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bd83d-f9db-404b-89cc-0970c1e0d3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:06.995277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bd83d-f9db-404b-89cc-0970c1e0d3b5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:07.084986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1316/2611] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:11:06 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:11:07.090170 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7feb82-7a65-489e-ac84-96999321ecec admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:07.100564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7feb82-7a65-489e-ac84-96999321ecec admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:07.127108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:07.159023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cf5a7-3e54-4332-8aa3-3c2025fe70e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:07.159822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cf5a7-3e54-4332-8aa3-3c2025fe70e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:07.160110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cf5a7-3e54-4332-8aa3-3c2025fe70e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:07.160392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cf5a7-3e54-4332-8aa3-3c2025fe70e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:07.161064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553cf5a7-3e54-4332-8aa3-3c2025fe70e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:07.163075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553cf5a7-3e54-4332-8aa3-3c2025fe70e6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:07.277232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1296/2612] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:11:07 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:11:07.281264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bd83d-f9db-404b-89cc-0970c1e0d3b5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:07.292143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bd83d-f9db-404b-89cc-0970c1e0d3b5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:07.296649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53faef6-e643-40a4-9b72-e42198051ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:07.297292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53faef6-e643-40a4-9b72-e42198051ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:07.297569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53faef6-e643-40a4-9b72-e42198051ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:07.297841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53faef6-e643-40a4-9b72-e42198051ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:07.298530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53faef6-e643-40a4-9b72-e42198051ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:07.300114 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53faef6-e643-40a4-9b72-e42198051ce5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:07.310099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1317/2613] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:11:07.314316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cf5a7-3e54-4332-8aa3-3c2025fe70e6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:07.324699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cf5a7-3e54-4332-8aa3-3c2025fe70e6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:07.329889 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae43f4-5298-4c3f-a0cc-e62b74431283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:07.330512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae43f4-5298-4c3f-a0cc-e62b74431283 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:07.330797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae43f4-5298-4c3f-a0cc-e62b74431283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:07.331147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae43f4-5298-4c3f-a0cc-e62b74431283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:07.331849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae43f4-5298-4c3f-a0cc-e62b74431283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:07.333512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae43f4-5298-4c3f-a0cc-e62b74431283 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:07.345562 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1297/2614] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:11:07.349733 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53faef6-e643-40a4-9b72-e42198051ce5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:07.360520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53faef6-e643-40a4-9b72-e42198051ce5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:07.364984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ab970-f614-45f1-9ac3-c8d70c36a269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:07.365674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ab970-f614-45f1-9ac3-c8d70c36a269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:07.365958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ab970-f614-45f1-9ac3-c8d70c36a269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:07.366238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ab970-f614-45f1-9ac3-c8d70c36a269 admin admin] PATH_INFO: `/v3/projects/bb344a5f91954d7e87105495d22f8598/users/3603c05f6c8e440e87c32569f17fad13/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:07.380869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ab970-f614-45f1-9ac3-c8d70c36a269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb344a5f91954d7e87105495d22f8598, user_id=3603c05f6c8e440e87c32569f17fad13, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:07.384226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ab970-f614-45f1-9ac3-c8d70c36a269 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:07.471898 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1318/2615] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:11:07 2022] PUT /identity/v3/projects/bb344a5f91954d7e87105495d22f8598/users/3603c05f6c8e440e87c32569f17fad13/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:07.482370 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be11b-5496-4f88-8841-6fd0ec69decb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:07.482679 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be11b-5496-4f88-8841-6fd0ec69decb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:07.482954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be11b-5496-4f88-8841-6fd0ec69decb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:07.511286 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a31be11b-5496-4f88-8841-6fd0ec69decb None None] MFA Rules not processed for user `3603c05f6c8e440e87c32569f17fad13`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:07.512482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a31be11b-5496-4f88-8841-6fd0ec69decb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:07.577546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1298/2616] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:11:07.589164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ab970-f614-45f1-9ac3-c8d70c36a269 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:07.591086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a12ab970-f614-45f1-9ac3-c8d70c36a269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:07.647626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ab970-f614-45f1-9ac3-c8d70c36a269 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:07.652272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a41438-897f-4713-85df-0d6afd729a8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a911a544e17e4fafb579da66973c431f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:07.652884 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a41438-897f-4713-85df-0d6afd729a8e service glance] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:07.653186 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a41438-897f-4713-85df-0d6afd729a8e service glance] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:07.653459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a41438-897f-4713-85df-0d6afd729a8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:07.661757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a41438-897f-4713-85df-0d6afd729a8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:07.663188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a41438-897f-4713-85df-0d6afd729a8e service glance] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:07.672163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1319/2617] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:17.574702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:17.669068 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:24.089690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31be11b-5496-4f88-8841-6fd0ec69decb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:24.091145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a31be11b-5496-4f88-8841-6fd0ec69decb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:24.147958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31be11b-5496-4f88-8841-6fd0ec69decb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:24.152169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640151-6284-43c0-b3ed-542648c3ea4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:24.152788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640151-6284-43c0-b3ed-542648c3ea4c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:24.153072 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640151-6284-43c0-b3ed-542648c3ea4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:24.153384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640151-6284-43c0-b3ed-542648c3ea4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:24.155168 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a3640151-6284-43c0-b3ed-542648c3ea4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:24.221248 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3640151-6284-43c0-b3ed-542648c3ea4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:24.222702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3640151-6284-43c0-b3ed-542648c3ea4c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:24.232864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1299/2618] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:24.778336 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a41438-897f-4713-85df-0d6afd729a8e service glance] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:24.790347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a41438-897f-4713-85df-0d6afd729a8e service glance] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:24.794663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:24.795293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:24.795693 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:24.795967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] PATH_INFO: `/v3/users/3603c05f6c8e440e87c32569f17fad13` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:24.797143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3603c05f6c8e440e87c32569f17fad13)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:24.799077 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:25.044526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3603c05f6c8e440e87c32569f17fad13'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:25.052038 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3603c05f6c8e440e87c32569f17fad13'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:25.140283 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3603c05f6c8e440e87c32569f17fad13'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:25.141057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3603c05f6c8e440e87c32569f17fad13'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:25.141832 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3603c05f6c8e440e87c32569f17fad13'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:25.166006 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1320/2619] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:11:24 2022] DELETE /identity/v3/users/3603c05f6c8e440e87c32569f17fad13 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:25.170578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f262-e58b-446d-acb8-d4c945a71509 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:25.171033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f262-e58b-446d-acb8-d4c945a71509 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:25.171227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f262-e58b-446d-acb8-d4c945a71509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:25.193356 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d915f262-e58b-446d-acb8-d4c945a71509 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:25.194878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d915f262-e58b-446d-acb8-d4c945a71509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:25.271717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1300/2620] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:25.283031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:25.286493 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:25.361749 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c632a3-9471-48c3-af53-67ac1d0acf9d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:25.365616 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fa15a-f4b1-4a5d-b96a-e68d8e59a474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:25.366243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fa15a-f4b1-4a5d-b96a-e68d8e59a474 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:25.366541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fa15a-f4b1-4a5d-b96a-e68d8e59a474 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:25.366800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fa15a-f4b1-4a5d-b96a-e68d8e59a474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:25.377051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fa15a-f4b1-4a5d-b96a-e68d8e59a474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:25.378558 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fa15a-f4b1-4a5d-b96a-e68d8e59a474 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:25.389879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1321/2621] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:26.090242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915f262-e58b-446d-acb8-d4c945a71509 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:26.090903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d915f262-e58b-446d-acb8-d4c945a71509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:26.107447 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915f262-e58b-446d-acb8-d4c945a71509 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:26.116022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:26.118985 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:26.118985 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:26.118985 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] PATH_INFO: `/v3/projects/bb344a5f91954d7e87105495d22f8598` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:26.119537 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb344a5f91954d7e87105495d22f8598)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:26.121566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:26.231389 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:26.234598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb344a5f91954d7e87105495d22f8598', 'request_id': 'req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:26.243346 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb344a5f91954d7e87105495d22f8598', 'request_id': 'req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:26.338185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb344a5f91954d7e87105495d22f8598', 'request_id': 'req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:26.350780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] The token cache is being invalidate because project bb344a5f91954d7e87105495d22f8598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:11:26.351226 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:26.351999 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6b466893-6dd6-4d3b-9ce9-14ed26e57cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:26.357682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1301/2622] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:11:26 2022] DELETE /identity/v3/projects/bb344a5f91954d7e87105495d22f8598 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:26.359121 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a274-adc1-410f-8797-0d704fd686a9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:26.359659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a274-adc1-410f-8797-0d704fd686a9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:26.359659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a274-adc1-410f-8797-0d704fd686a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:26.380987 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1018a274-adc1-410f-8797-0d704fd686a9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:26.382249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1018a274-adc1-410f-8797-0d704fd686a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:26.457449 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1322/2623] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:11:26.466081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d016d7-9a81-4250-8124-91c3a47396e2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:26.467718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d016d7-9a81-4250-8124-91c3a47396e2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:26.468111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d016d7-9a81-4250-8124-91c3a47396e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:26.491765 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c6d016d7-9a81-4250-8124-91c3a47396e2 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:26.493950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c6d016d7-9a81-4250-8124-91c3a47396e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:26.503809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1302/2624] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:26.508124 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a274-adc1-410f-8797-0d704fd686a9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:26.519109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a274-adc1-410f-8797-0d704fd686a9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:26.524815 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f220ed8-82af-43bc-8834-9112a938ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:26.526027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f220ed8-82af-43bc-8834-9112a938ddcc admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:26.526027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f220ed8-82af-43bc-8834-9112a938ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:26.532678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f220ed8-82af-43bc-8834-9112a938ddcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:26.532678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f220ed8-82af-43bc-8834-9112a938ddcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:11:26.532678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f220ed8-82af-43bc-8834-9112a938ddcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:26.532678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f220ed8-82af-43bc-8834-9112a938ddcc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:26.542421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1323/2625] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:11:26.546465 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d016d7-9a81-4250-8124-91c3a47396e2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:26.558606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d016d7-9a81-4250-8124-91c3a47396e2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:26.564426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab142-7a02-45ed-b540-907a888d78fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:26.565061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab142-7a02-45ed-b540-907a888d78fc admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:26.565382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab142-7a02-45ed-b540-907a888d78fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:26.565644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab142-7a02-45ed-b540-907a888d78fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:26.566354 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ab142-7a02-45ed-b540-907a888d78fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:26.568853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ab142-7a02-45ed-b540-907a888d78fc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:26.699647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1303/2626] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:11:26 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:11:26.703837 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f220ed8-82af-43bc-8834-9112a938ddcc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:26.709111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:26.714854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f220ed8-82af-43bc-8834-9112a938ddcc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:26.773059 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1feb0d-07f1-4cc2-a216-8600e32572c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:26.773705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1feb0d-07f1-4cc2-a216-8600e32572c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:26.774033 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1feb0d-07f1-4cc2-a216-8600e32572c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:26.774425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1feb0d-07f1-4cc2-a216-8600e32572c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:26.775308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1feb0d-07f1-4cc2-a216-8600e32572c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:26.777259 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1feb0d-07f1-4cc2-a216-8600e32572c7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:26.891870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1324/2627] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:11:26 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:11:26.895622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab142-7a02-45ed-b540-907a888d78fc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:26.906487 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab142-7a02-45ed-b540-907a888d78fc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:26.911740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7a802-54c5-46ae-baca-e1f87f674a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:26.912316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a802-54c5-46ae-baca-e1f87f674a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:26.912595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a802-54c5-46ae-baca-e1f87f674a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:26.913147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a802-54c5-46ae-baca-e1f87f674a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:26.913863 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7a802-54c5-46ae-baca-e1f87f674a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:26.916022 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7a802-54c5-46ae-baca-e1f87f674a13 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:26.927154 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1304/2628] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:11:26.932499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1feb0d-07f1-4cc2-a216-8600e32572c7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:26.943383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1feb0d-07f1-4cc2-a216-8600e32572c7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:26.949341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea9b96-5dcd-454a-8d5a-9f23ca640490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:26.949966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea9b96-5dcd-454a-8d5a-9f23ca640490 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:26.950246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea9b96-5dcd-454a-8d5a-9f23ca640490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:26.950601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea9b96-5dcd-454a-8d5a-9f23ca640490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:26.951251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea9b96-5dcd-454a-8d5a-9f23ca640490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:26.952918 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea9b96-5dcd-454a-8d5a-9f23ca640490 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:26.975403 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1325/2629] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:11:26.983775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7a802-54c5-46ae-baca-e1f87f674a13 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:26.995252 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7a802-54c5-46ae-baca-e1f87f674a13 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:27.000002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d0c77-f813-4ced-ba29-641d122db4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:27.001451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d0c77-f813-4ced-ba29-641d122db4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:27.001821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d0c77-f813-4ced-ba29-641d122db4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:27.002108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d0c77-f813-4ced-ba29-641d122db4ec admin admin] PATH_INFO: `/v3/projects/723890dbe52c422ba8347b7b842a0cd9/users/560c53f082994abdb68e8b7113fc5831/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:27.018901 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d0c77-f813-4ced-ba29-641d122db4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=723890dbe52c422ba8347b7b842a0cd9, user_id=560c53f082994abdb68e8b7113fc5831, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:27.021797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d0c77-f813-4ced-ba29-641d122db4ec admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:27.100666 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1305/2630] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:11:26 2022] PUT /identity/v3/projects/723890dbe52c422ba8347b7b842a0cd9/users/560c53f082994abdb68e8b7113fc5831/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:27.107651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc02c19-f0f4-4184-b7cb-ff19b77bfe36 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:27.108136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc02c19-f0f4-4184-b7cb-ff19b77bfe36 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:27.108501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc02c19-f0f4-4184-b7cb-ff19b77bfe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:27.127879 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ffc02c19-f0f4-4184-b7cb-ff19b77bfe36 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:27.130199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ffc02c19-f0f4-4184-b7cb-ff19b77bfe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:27.192366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1326/2631] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:11:27.202317 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d0c77-f813-4ced-ba29-641d122db4ec admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:27.204019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4b4d0c77-f813-4ced-ba29-641d122db4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:27.263687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d0c77-f813-4ced-ba29-641d122db4ec admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:27.267910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdd3c-81bd-454d-ac9e-faff73d9e653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:27.268559 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdd3c-81bd-454d-ac9e-faff73d9e653 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:27.268841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdd3c-81bd-454d-ac9e-faff73d9e653 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:27.269282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdd3c-81bd-454d-ac9e-faff73d9e653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:27.284945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bdd3c-81bd-454d-ac9e-faff73d9e653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:27.286524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bdd3c-81bd-454d-ac9e-faff73d9e653 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:27.297712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1306/2632] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:11:28.022284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc02c19-f0f4-4184-b7cb-ff19b77bfe36 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:28.023822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ffc02c19-f0f4-4184-b7cb-ff19b77bfe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:28.097829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc02c19-f0f4-4184-b7cb-ff19b77bfe36 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:28.103103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358e4d3-8277-426b-b525-8a0b533c7914 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:28.103739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358e4d3-8277-426b-b525-8a0b533c7914 service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:28.104017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358e4d3-8277-426b-b525-8a0b533c7914 service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:28.104292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358e4d3-8277-426b-b525-8a0b533c7914 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:28.106316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6358e4d3-8277-426b-b525-8a0b533c7914 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:28.119658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358e4d3-8277-426b-b525-8a0b533c7914 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:28.121596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358e4d3-8277-426b-b525-8a0b533c7914 service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:28.134016 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1327/2633] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:28.257202 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdd3c-81bd-454d-ac9e-faff73d9e653 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:28.259362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f83bdd3c-81bd-454d-ac9e-faff73d9e653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:28.273610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdd3c-81bd-454d-ac9e-faff73d9e653 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:28.277941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:28.278583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:28.278867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:28.279142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] PATH_INFO: `/v3/users/fbc4fc1f207c4726b9c05b6b338f0e9c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:28.280322 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc4fc1f207c4726b9c05b6b338f0e9c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:28.282290 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:28.494935 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc4fc1f207c4726b9c05b6b338f0e9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:28.495538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc4fc1f207c4726b9c05b6b338f0e9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:28.555311 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc4fc1f207c4726b9c05b6b338f0e9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:28.567122 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:28.569576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc4fc1f207c4726b9c05b6b338f0e9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:28.577660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e0833f83-160f-4581-891f-37cf1b11414e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc4fc1f207c4726b9c05b6b338f0e9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:28.713937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1307/2634] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:11:28 2022] DELETE /identity/v3/users/fbc4fc1f207c4726b9c05b6b338f0e9c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:28.854754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358e4d3-8277-426b-b525-8a0b533c7914 service placement] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:28.871177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358e4d3-8277-426b-b525-8a0b533c7914 service placement] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:28.879903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:28.902529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1fbad-12aa-484e-9a56-5ee33538b94f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:28.903563 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1fbad-12aa-484e-9a56-5ee33538b94f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:28.903996 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1fbad-12aa-484e-9a56-5ee33538b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:28.937142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d8a1fbad-12aa-484e-9a56-5ee33538b94f None None] MFA Rules not processed for user `560c53f082994abdb68e8b7113fc5831`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:28.938669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d8a1fbad-12aa-484e-9a56-5ee33538b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:28.952746 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:28.953641 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:28.954044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:28.954399 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] PATH_INFO: `/v3/projects/16a417bb74d445f7b2240ccb27061f05` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:28.955886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a417bb74d445f7b2240ccb27061f05)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:28.958308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:29.013019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1308/2635] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:29.023787 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1fbad-12aa-484e-9a56-5ee33538b94f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:29.025974 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d8a1fbad-12aa-484e-9a56-5ee33538b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:29.073474 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a417bb74d445f7b2240ccb27061f05', 'request_id': 'req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:29.079966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a417bb74d445f7b2240ccb27061f05', 'request_id': 'req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:29.087127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a417bb74d445f7b2240ccb27061f05', 'request_id': 'req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:29.088340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1fbad-12aa-484e-9a56-5ee33538b94f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:29.138336 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50a353-ce7b-4de7-ae54-cf8e7fbafe6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:29.138951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a353-ce7b-4de7-ae54-cf8e7fbafe6c service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:29.139235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a353-ce7b-4de7-ae54-cf8e7fbafe6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:29.139513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a353-ce7b-4de7-ae54-cf8e7fbafe6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:29.183264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:29.196257 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50a353-ce7b-4de7-ae54-cf8e7fbafe6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:29.197878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50a353-ce7b-4de7-ae54-cf8e7fbafe6c service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:29.201098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] The token cache is being invalidate because project 16a417bb74d445f7b2240ccb27061f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:11:29.203989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:29.203989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b4d5b535-ea8a-4cf7-8994-6e97bb33597b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:11:29.203989 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1328/2636] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:11:28 2022] DELETE /identity/v3/projects/16a417bb74d445f7b2240ccb27061f05 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:29.207173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1309/2637] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:11:29.208299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7e264-6a58-491f-8309-e0de4225d96d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:29.208589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7e264-6a58-491f-8309-e0de4225d96d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:29.208869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7e264-6a58-491f-8309-e0de4225d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:29.229470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ccb7e264-6a58-491f-8309-e0de4225d96d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:29.232402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ccb7e264-6a58-491f-8309-e0de4225d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:29.293751 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1329/2638] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:11:29.301824 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb416399-d630-4635-a063-f948b30196ef None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:29.302351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb416399-d630-4635-a063-f948b30196ef None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:29.302351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb416399-d630-4635-a063-f948b30196ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:29.325320 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bb416399-d630-4635-a063-f948b30196ef None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:29.326545 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bb416399-d630-4635-a063-f948b30196ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:29.334670 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1310/2639] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:29.339612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7e264-6a58-491f-8309-e0de4225d96d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:29.349537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7e264-6a58-491f-8309-e0de4225d96d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:29.354415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24135774-42c8-4f02-8103-87d3630f5d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:29.355030 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24135774-42c8-4f02-8103-87d3630f5d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:29.355338 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24135774-42c8-4f02-8103-87d3630f5d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:29.355669 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24135774-42c8-4f02-8103-87d3630f5d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:29.356312 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24135774-42c8-4f02-8103-87d3630f5d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:11:29.356618 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24135774-42c8-4f02-8103-87d3630f5d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:29.358274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24135774-42c8-4f02-8103-87d3630f5d50 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:29.370634 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1330/2640] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:11:29.375105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb416399-d630-4635-a063-f948b30196ef None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:29.385132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb416399-d630-4635-a063-f948b30196ef None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:29.389811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923cab1-18bc-4ca8-b19d-ce18f082aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:29.390427 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923cab1-18bc-4ca8-b19d-ce18f082aa42 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:29.390690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923cab1-18bc-4ca8-b19d-ce18f082aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:29.390960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923cab1-18bc-4ca8-b19d-ce18f082aa42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:29.391614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923cab1-18bc-4ca8-b19d-ce18f082aa42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:29.393588 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923cab1-18bc-4ca8-b19d-ce18f082aa42 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:29.479029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1311/2641] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:11:29 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:11:29.483297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24135774-42c8-4f02-8103-87d3630f5d50 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:29.493928 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24135774-42c8-4f02-8103-87d3630f5d50 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:29.520034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:29.550661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c84c-bda6-4a7d-9a5f-a29005b66428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:29.551306 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c84c-bda6-4a7d-9a5f-a29005b66428 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:29.551568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c84c-bda6-4a7d-9a5f-a29005b66428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:29.551843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c84c-bda6-4a7d-9a5f-a29005b66428 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:29.552520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8c84c-bda6-4a7d-9a5f-a29005b66428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:29.554480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8c84c-bda6-4a7d-9a5f-a29005b66428 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:29.650010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1331/2642] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:11:29 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:11:29.654538 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923cab1-18bc-4ca8-b19d-ce18f082aa42 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:29.665160 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923cab1-18bc-4ca8-b19d-ce18f082aa42 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:29.669987 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d4f37-9e05-490f-abda-e10b8bc2c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:29.670645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d4f37-9e05-490f-abda-e10b8bc2c9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:29.670928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d4f37-9e05-490f-abda-e10b8bc2c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:29.671211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d4f37-9e05-490f-abda-e10b8bc2c9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:29.671910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d4f37-9e05-490f-abda-e10b8bc2c9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:29.673564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d4f37-9e05-490f-abda-e10b8bc2c9aa admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:29.684293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1312/2643] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:11:29.688390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c84c-bda6-4a7d-9a5f-a29005b66428 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:29.699199 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c84c-bda6-4a7d-9a5f-a29005b66428 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:29.703886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e8252-0de6-4e13-bdec-9dc156c21fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:29.704488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8252-0de6-4e13-bdec-9dc156c21fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:29.704764 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8252-0de6-4e13-bdec-9dc156c21fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:29.705032 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8252-0de6-4e13-bdec-9dc156c21fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:29.705753 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e8252-0de6-4e13-bdec-9dc156c21fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:29.707337 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e8252-0de6-4e13-bdec-9dc156c21fa8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:29.717854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1332/2644] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:11:29.722308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d4f37-9e05-490f-abda-e10b8bc2c9aa admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:29.732420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d4f37-9e05-490f-abda-e10b8bc2c9aa admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:29.737141 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe2479-f76a-4b86-82fe-6728aa5426eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:29.737813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe2479-f76a-4b86-82fe-6728aa5426eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:29.738095 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe2479-f76a-4b86-82fe-6728aa5426eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:29.738375 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe2479-f76a-4b86-82fe-6728aa5426eb admin admin] PATH_INFO: `/v3/projects/bca196a6befb4fae9531dc96a1e58d5f/users/f54ad4a554de414a80ed03d62c1eb3a5/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:29.753569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe2479-f76a-4b86-82fe-6728aa5426eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca196a6befb4fae9531dc96a1e58d5f, user_id=f54ad4a554de414a80ed03d62c1eb3a5, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:29.756284 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe2479-f76a-4b86-82fe-6728aa5426eb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:29.827150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1313/2645] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:11:29 2022] PUT /identity/v3/projects/bca196a6befb4fae9531dc96a1e58d5f/users/f54ad4a554de414a80ed03d62c1eb3a5/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:11:29.832248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94089e-4793-45ee-ae0c-f42615694d4d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:29.832536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94089e-4793-45ee-ae0c-f42615694d4d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:29.832811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94089e-4793-45ee-ae0c-f42615694d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:29.853242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1a94089e-4793-45ee-ae0c-f42615694d4d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:29.854694 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1a94089e-4793-45ee-ae0c-f42615694d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:29.924689 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1333/2646] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:29.935153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe2479-f76a-4b86-82fe-6728aa5426eb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:29.936997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-26fe2479-f76a-4b86-82fe-6728aa5426eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:30.001431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe2479-f76a-4b86-82fe-6728aa5426eb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:30.005177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c854e2-5206-4a27-b567-f3be7c14519c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:30.005807 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c854e2-5206-4a27-b567-f3be7c14519c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:30.006110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c854e2-5206-4a27-b567-f3be7c14519c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:30.006515 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c854e2-5206-4a27-b567-f3be7c14519c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:30.016337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c854e2-5206-4a27-b567-f3be7c14519c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:30.017903 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c854e2-5206-4a27-b567-f3be7c14519c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:30.027761 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1314/2647] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:30.988477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed60bc-cd16-409f-8c5b-2dedf5eaf4be None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:30.988993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed60bc-cd16-409f-8c5b-2dedf5eaf4be None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:30.999151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed60bc-cd16-409f-8c5b-2dedf5eaf4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:31.008503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a6ed60bc-cd16-409f-8c5b-2dedf5eaf4be None None] MFA Rules not processed for user `560c53f082994abdb68e8b7113fc5831`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:31.009776 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a6ed60bc-cd16-409f-8c5b-2dedf5eaf4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:31.069899 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1334/2648] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:31.315339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c854e2-5206-4a27-b567-f3be7c14519c service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:31.316828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c9c854e2-5206-4a27-b567-f3be7c14519c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:31.328820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c854e2-5206-4a27-b567-f3be7c14519c service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:31.332619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04debb2-a073-4e13-8166-55c064f9dcc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:31.333265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04debb2-a073-4e13-8166-55c064f9dcc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:31.342340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04debb2-a073-4e13-8166-55c064f9dcc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:31.342340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04debb2-a073-4e13-8166-55c064f9dcc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:31.342340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e04debb2-a073-4e13-8166-55c064f9dcc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:31.346368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04debb2-a073-4e13-8166-55c064f9dcc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:31.347813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04debb2-a073-4e13-8166-55c064f9dcc0 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:31.356214 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1315/2649] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:35.720901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682a7b3-005f-4738-8449-9dce6f0e44f9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:35.721465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682a7b3-005f-4738-8449-9dce6f0e44f9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:35.721465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682a7b3-005f-4738-8449-9dce6f0e44f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:35.763262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e682a7b3-005f-4738-8449-9dce6f0e44f9 None None] MFA Rules not processed for user `f54ad4a554de414a80ed03d62c1eb3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:35.764510 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e682a7b3-005f-4738-8449-9dce6f0e44f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:35.813503 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:35.862213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1335/2650] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:35.876399 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04debb2-a073-4e13-8166-55c064f9dcc0 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:35.878495 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e04debb2-a073-4e13-8166-55c064f9dcc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:35.971950 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04debb2-a073-4e13-8166-55c064f9dcc0 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:35.978717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0577c-ef63-459b-a6d3-07d3c66400c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:35.983796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0577c-ef63-459b-a6d3-07d3c66400c4 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:35.983796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0577c-ef63-459b-a6d3-07d3c66400c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:35.983796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0577c-ef63-459b-a6d3-07d3c66400c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:35.987002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:35.990805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0577c-ef63-459b-a6d3-07d3c66400c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:35.993018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0577c-ef63-459b-a6d3-07d3c66400c4 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:36.003828 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1316/2651] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:39.088873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca10d2f-0941-4e4b-8624-ebe1245edfcc None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:39.089500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca10d2f-0941-4e4b-8624-ebe1245edfcc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:39.089500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca10d2f-0941-4e4b-8624-ebe1245edfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:39.110555 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9ca10d2f-0941-4e4b-8624-ebe1245edfcc None None] MFA Rules not processed for user `f54ad4a554de414a80ed03d62c1eb3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:39.111929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9ca10d2f-0941-4e4b-8624-ebe1245edfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:39.119147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1336/2652] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:45.949009 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0577c-ef63-459b-a6d3-07d3c66400c4 service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:45.960499 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0577c-ef63-459b-a6d3-07d3c66400c4 service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:45.967276 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b00b12-6777-40cc-929a-b4fe42876a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:45.967913 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b00b12-6777-40cc-929a-b4fe42876a75 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:45.968203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b00b12-6777-40cc-929a-b4fe42876a75 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:45.968474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b00b12-6777-40cc-929a-b4fe42876a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:45.970579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-55b00b12-6777-40cc-929a-b4fe42876a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:45.984768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b00b12-6777-40cc-929a-b4fe42876a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:45.986424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b00b12-6777-40cc-929a-b4fe42876a75 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:45.998449 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1317/2653] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:48.420762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834e93b-3beb-461d-8a8c-cd958e2ff3bc None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:48.421326 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834e93b-3beb-461d-8a8c-cd958e2ff3bc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:48.421439 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834e93b-3beb-461d-8a8c-cd958e2ff3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:48.440396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a834e93b-3beb-461d-8a8c-cd958e2ff3bc None None] MFA Rules not processed for user `560c53f082994abdb68e8b7113fc5831`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:11:48.441652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a834e93b-3beb-461d-8a8c-cd958e2ff3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:48.449148 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1337/2654] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:11:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:11:48.688392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b00b12-6777-40cc-929a-b4fe42876a75 service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:11:48.698541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b00b12-6777-40cc-929a-b4fe42876a75 service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:11:48.702438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5e19-d88e-4271-a85c-1c4cc165b637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:11:48.703050 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5e19-d88e-4271-a85c-1c4cc165b637 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:11:48.703335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5e19-d88e-4271-a85c-1c4cc165b637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:11:48.703612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5e19-d88e-4271-a85c-1c4cc165b637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:11:48.705377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-37cd5e19-d88e-4271-a85c-1c4cc165b637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:11:48.717292 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd5e19-d88e-4271-a85c-1c4cc165b637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:11:48.718728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd5e19-d88e-4271-a85c-1c4cc165b637 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:11:48.727278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1318/2655] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:11:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:11:58.434870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=14 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:58.723280 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=14 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:10.956377 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5357593-6b1d-4d6b-b0bb-400d78eb73a9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:10.956857 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5357593-6b1d-4d6b-b0bb-400d78eb73a9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:10.956964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5357593-6b1d-4d6b-b0bb-400d78eb73a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:10.975701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b5357593-6b1d-4d6b-b0bb-400d78eb73a9 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:10.976855 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b5357593-6b1d-4d6b-b0bb-400d78eb73a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:11.037408 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1338/2656] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:12:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:11.184062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5e19-d88e-4271-a85c-1c4cc165b637 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:11.185605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-37cd5e19-d88e-4271-a85c-1c4cc165b637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:11.253267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5e19-d88e-4271-a85c-1c4cc165b637 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:11.258522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad11465-3228-405a-a81b-81309e06ee4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:11.259142 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11465-3228-405a-a81b-81309e06ee4e service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:11.259424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11465-3228-405a-a81b-81309e06ee4e service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:11.259699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11465-3228-405a-a81b-81309e06ee4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:11.267628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad11465-3228-405a-a81b-81309e06ee4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:11.269512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad11465-3228-405a-a81b-81309e06ee4e service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:11.277362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1319/2657] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:12:21.031023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=28 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:21.274355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=32 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:27.698992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa603b-f00a-40d3-98fd-283813abe3a6 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:27.699458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa603b-f00a-40d3-98fd-283813abe3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:27.699571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa603b-f00a-40d3-98fd-283813abe3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:27.718321 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c4fa603b-f00a-40d3-98fd-283813abe3a6 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:27.719526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c4fa603b-f00a-40d3-98fd-283813abe3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:27.727249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1339/2658] 10.222.0.55 () {58 vars in 967 bytes} [Mon Jul 25 23:12:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:27.739089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad11465-3228-405a-a81b-81309e06ee4e service swift] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:27.750793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad11465-3228-405a-a81b-81309e06ee4e service swift] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:27.755728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafb2f6-127b-4d1e-9c95-9816d3b76ad5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:27.756813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafb2f6-127b-4d1e-9c95-9816d3b76ad5 service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:27.757162 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafb2f6-127b-4d1e-9c95-9816d3b76ad5 service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:27.757437 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafb2f6-127b-4d1e-9c95-9816d3b76ad5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:27.765338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafb2f6-127b-4d1e-9c95-9816d3b76ad5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:27.766934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafb2f6-127b-4d1e-9c95-9816d3b76ad5 service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:27.775603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1320/2659] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:12:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:12:30.615985 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa603b-f00a-40d3-98fd-283813abe3a6 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:30.617696 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c4fa603b-f00a-40d3-98fd-283813abe3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:30.633820 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa603b-f00a-40d3-98fd-283813abe3a6 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:30.638996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:30.639649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:30.639930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:30.640206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] PATH_INFO: `/v3/users/560c53f082994abdb68e8b7113fc5831` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:30.641438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=560c53f082994abdb68e8b7113fc5831)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:30.643646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:30.821285 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560c53f082994abdb68e8b7113fc5831'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:12:30.828043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560c53f082994abdb68e8b7113fc5831'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:12:30.927576 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560c53f082994abdb68e8b7113fc5831'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:12:30.928961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560c53f082994abdb68e8b7113fc5831'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:12:30.929763 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9a64b39d-4623-4b87-ac45-ef2200218a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560c53f082994abdb68e8b7113fc5831'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:12:30.948325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1340/2660] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:12:30 2022] DELETE /identity/v3/users/560c53f082994abdb68e8b7113fc5831 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:12:31.178325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafb2f6-127b-4d1e-9c95-9816d3b76ad5 service swift] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:31.190759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafb2f6-127b-4d1e-9c95-9816d3b76ad5 service swift] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:31.251662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:31.252308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:31.252592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:31.252868 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] PATH_INFO: `/v3/projects/723890dbe52c422ba8347b7b842a0cd9` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:31.254068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723890dbe52c422ba8347b7b842a0cd9)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:31.255978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:31.364980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723890dbe52c422ba8347b7b842a0cd9', 'request_id': 'req-2fcc7270-25bc-4799-9ad7-4b582974b832'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:12:31.371206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723890dbe52c422ba8347b7b842a0cd9', 'request_id': 'req-2fcc7270-25bc-4799-9ad7-4b582974b832'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:12:31.459941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723890dbe52c422ba8347b7b842a0cd9', 'request_id': 'req-2fcc7270-25bc-4799-9ad7-4b582974b832'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:12:31.471115 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] The token cache is being invalidate because project 723890dbe52c422ba8347b7b842a0cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:12:31.471407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:12:31.472040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2fcc7270-25bc-4799-9ad7-4b582974b832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:12:31.473605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1321/2661] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:12:31 2022] DELETE /identity/v3/projects/723890dbe52c422ba8347b7b842a0cd9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:12:31.478492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b52811-b433-4e08-b15c-7e45fbc84e5d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:31.478781 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b52811-b433-4e08-b15c-7e45fbc84e5d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:31.479058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b52811-b433-4e08-b15c-7e45fbc84e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:31.498415 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-12b52811-b433-4e08-b15c-7e45fbc84e5d None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:31.499613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-12b52811-b433-4e08-b15c-7e45fbc84e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:31.566938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1341/2662] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:31.574992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66053a8b-9fce-42e1-bd7d-736cf1d29913 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:31.575282 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66053a8b-9fce-42e1-bd7d-736cf1d29913 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:31.575563 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66053a8b-9fce-42e1-bd7d-736cf1d29913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:31.596185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-66053a8b-9fce-42e1-bd7d-736cf1d29913 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:31.599361 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-66053a8b-9fce-42e1-bd7d-736cf1d29913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:31.605867 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1322/2663] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:31.610206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b52811-b433-4e08-b15c-7e45fbc84e5d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:31.619947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b52811-b433-4e08-b15c-7e45fbc84e5d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:31.624714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc2b1a-011b-4b75-bf2a-94c94b6c5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:31.625366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc2b1a-011b-4b75-bf2a-94c94b6c5b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:31.625652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc2b1a-011b-4b75-bf2a-94c94b6c5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:31.625949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc2b1a-011b-4b75-bf2a-94c94b6c5b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:31.626681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc2b1a-011b-4b75-bf2a-94c94b6c5b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:12:31.627058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc2b1a-011b-4b75-bf2a-94c94b6c5b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:31.628718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc2b1a-011b-4b75-bf2a-94c94b6c5b4d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:31.644396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1342/2664] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:12:31.645602 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66053a8b-9fce-42e1-bd7d-736cf1d29913 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:31.655522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66053a8b-9fce-42e1-bd7d-736cf1d29913 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:31.660215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b767d33-873d-45a1-81a0-f092f4b38051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:31.660855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b767d33-873d-45a1-81a0-f092f4b38051 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:31.661169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b767d33-873d-45a1-81a0-f092f4b38051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:31.661454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b767d33-873d-45a1-81a0-f092f4b38051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:31.666599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b767d33-873d-45a1-81a0-f092f4b38051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:31.666599 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b767d33-873d-45a1-81a0-f092f4b38051 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:31.755742 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1323/2665] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:12:31 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:12:31.760599 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc2b1a-011b-4b75-bf2a-94c94b6c5b4d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:31.771122 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc2b1a-011b-4b75-bf2a-94c94b6c5b4d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:31.817434 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:31.826730 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ae492-c818-4b1c-a5b1-cee29d8b3d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:31.827343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ae492-c818-4b1c-a5b1-cee29d8b3d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:31.827624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ae492-c818-4b1c-a5b1-cee29d8b3d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:31.827903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ae492-c818-4b1c-a5b1-cee29d8b3d9e admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:31.828564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ae492-c818-4b1c-a5b1-cee29d8b3d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:31.830517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ae492-c818-4b1c-a5b1-cee29d8b3d9e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:31.908150 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1343/2666] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:12:31 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:12:31.912246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b767d33-873d-45a1-81a0-f092f4b38051 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:31.922585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b767d33-873d-45a1-81a0-f092f4b38051 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:31.927213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912f93e-6a2a-4cf7-b49a-72cac0da363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:31.927811 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912f93e-6a2a-4cf7-b49a-72cac0da363b admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:31.928636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912f93e-6a2a-4cf7-b49a-72cac0da363b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:31.929062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912f93e-6a2a-4cf7-b49a-72cac0da363b admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:31.929596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912f93e-6a2a-4cf7-b49a-72cac0da363b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:31.931180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912f93e-6a2a-4cf7-b49a-72cac0da363b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:31.946321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1324/2667] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:12:31.947993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ae492-c818-4b1c-a5b1-cee29d8b3d9e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:31.958026 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ae492-c818-4b1c-a5b1-cee29d8b3d9e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:31.963003 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd5d2-0a12-43ff-bf8d-c5f592bdd997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:31.963622 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd5d2-0a12-43ff-bf8d-c5f592bdd997 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:31.964236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd5d2-0a12-43ff-bf8d-c5f592bdd997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:31.964236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd5d2-0a12-43ff-bf8d-c5f592bdd997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:31.964860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd5d2-0a12-43ff-bf8d-c5f592bdd997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:31.966637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd5d2-0a12-43ff-bf8d-c5f592bdd997 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:31.978249 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1344/2668] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:12:31.982551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912f93e-6a2a-4cf7-b49a-72cac0da363b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:31.994362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912f93e-6a2a-4cf7-b49a-72cac0da363b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:31.999271 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc7d57-75a8-4be4-bb02-24f0e5088f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:31.999938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7d57-75a8-4be4-bb02-24f0e5088f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:32.000223 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7d57-75a8-4be4-bb02-24f0e5088f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:32.000504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7d57-75a8-4be4-bb02-24f0e5088f9c admin admin] PATH_INFO: `/v3/projects/787b6ca7d2cc41de912fc3b451025569/users/ca9826f5a2b2448ab9363d7717ffc16f/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:32.017055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc7d57-75a8-4be4-bb02-24f0e5088f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=787b6ca7d2cc41de912fc3b451025569, user_id=ca9826f5a2b2448ab9363d7717ffc16f, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:32.019997 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc7d57-75a8-4be4-bb02-24f0e5088f9c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:32.105642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1325/2669] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:12:31 2022] PUT /identity/v3/projects/787b6ca7d2cc41de912fc3b451025569/users/ca9826f5a2b2448ab9363d7717ffc16f/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:12:32.117601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446b703-d027-41f4-85d5-01786ad4c751 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:32.117932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446b703-d027-41f4-85d5-01786ad4c751 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:32.118173 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446b703-d027-41f4-85d5-01786ad4c751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:32.145274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b446b703-d027-41f4-85d5-01786ad4c751 None None] MFA Rules not processed for user `ca9826f5a2b2448ab9363d7717ffc16f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:32.146496 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b446b703-d027-41f4-85d5-01786ad4c751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:32.210390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1345/2670] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:12:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:32.221726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc7d57-75a8-4be4-bb02-24f0e5088f9c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:32.223387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-95fc7d57-75a8-4be4-bb02-24f0e5088f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:32.238211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:32.280848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc7d57-75a8-4be4-bb02-24f0e5088f9c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:32.284983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c37aa-ad81-4b51-8ff8-d30929d18698 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a911a544e17e4fafb579da66973c431f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:32.285630 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c37aa-ad81-4b51-8ff8-d30929d18698 service glance] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:32.285914 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c37aa-ad81-4b51-8ff8-d30929d18698 service glance] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:32.286193 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c37aa-ad81-4b51-8ff8-d30929d18698 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:32.295088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c37aa-ad81-4b51-8ff8-d30929d18698 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:32.296517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c37aa-ad81-4b51-8ff8-d30929d18698 service glance] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:32.305770 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1326/2671] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:42.207367 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:42.410840 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=20 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:43.249234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452c8d0-b741-42bd-8847-bc5c6c749055 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:43.254221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452c8d0-b741-42bd-8847-bc5c6c749055 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:43.254221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452c8d0-b741-42bd-8847-bc5c6c749055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:43.271092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b452c8d0-b741-42bd-8847-bc5c6c749055 None None] MFA Rules not processed for user `f54ad4a554de414a80ed03d62c1eb3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:43.272935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b452c8d0-b741-42bd-8847-bc5c6c749055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:43.327524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1346/2672] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:12:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:45.374916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c37aa-ad81-4b51-8ff8-d30929d18698 service glance] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:45.376371 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f24c37aa-ad81-4b51-8ff8-d30929d18698 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:45.473285 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c37aa-ad81-4b51-8ff8-d30929d18698 service glance] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:45.478643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779d343-3b8d-43b9-8bab-70702d4d49fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:45.479260 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d343-3b8d-43b9-8bab-70702d4d49fc service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:45.479542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d343-3b8d-43b9-8bab-70702d4d49fc service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:45.479825 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d343-3b8d-43b9-8bab-70702d4d49fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:45.481617 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a779d343-3b8d-43b9-8bab-70702d4d49fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:45.494331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779d343-3b8d-43b9-8bab-70702d4d49fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:45.495964 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779d343-3b8d-43b9-8bab-70702d4d49fc service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:45.506729 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1327/2673] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:53.320683 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=25 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:55.501510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=41 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:05.333089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452c8d0-b741-42bd-8847-bc5c6c749055 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:05.394806 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452c8d0-b741-42bd-8847-bc5c6c749055 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:05.399974 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:05.400612 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:05.400892 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:05.401195 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] PATH_INFO: `/v3/users/ca9826f5a2b2448ab9363d7717ffc16f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:05.402365 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9826f5a2b2448ab9363d7717ffc16f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:05.404262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:05.578609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9826f5a2b2448ab9363d7717ffc16f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:05.586012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9826f5a2b2448ab9363d7717ffc16f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:05.655550 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9826f5a2b2448ab9363d7717ffc16f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:05.656265 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9826f5a2b2448ab9363d7717ffc16f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:05.656958 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9826f5a2b2448ab9363d7717ffc16f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:05.674527 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1347/2674] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:13:05 2022] DELETE /identity/v3/users/ca9826f5a2b2448ab9363d7717ffc16f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:13:05.680325 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc0ecd-2692-4bf6-a128-78e916ec2c70 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:05.680794 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc0ecd-2692-4bf6-a128-78e916ec2c70 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:05.680916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc0ecd-2692-4bf6-a128-78e916ec2c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:05.700699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-82bc0ecd-2692-4bf6-a128-78e916ec2c70 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:05.701928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-82bc0ecd-2692-4bf6-a128-78e916ec2c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:05.759978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1328/2675] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:13:05.769888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:05.771270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:05.826816 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069568d7-f78a-4f9a-bc81-989d63bc27e7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:05.830536 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147ecdf-d677-4e0c-a9e7-8f7e6d01085e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:05.831084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147ecdf-d677-4e0c-a9e7-8f7e6d01085e service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:05.831356 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147ecdf-d677-4e0c-a9e7-8f7e6d01085e service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:05.831632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147ecdf-d677-4e0c-a9e7-8f7e6d01085e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:05.840717 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147ecdf-d677-4e0c-a9e7-8f7e6d01085e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:05.842196 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147ecdf-d677-4e0c-a9e7-8f7e6d01085e service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:05.852240 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1348/2676] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:06.260145 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc0ecd-2692-4bf6-a128-78e916ec2c70 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:06.263228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-82bc0ecd-2692-4bf6-a128-78e916ec2c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:06.276268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc0ecd-2692-4bf6-a128-78e916ec2c70 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:06.281020 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:06.281695 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:06.281978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:06.282255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] PATH_INFO: `/v3/projects/787b6ca7d2cc41de912fc3b451025569` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:06.283411 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=787b6ca7d2cc41de912fc3b451025569)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:06.285364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:06.375905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '787b6ca7d2cc41de912fc3b451025569', 'request_id': 'req-9d371883-66d4-46c1-863f-aa020e4da1b8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:06.382187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '787b6ca7d2cc41de912fc3b451025569', 'request_id': 'req-9d371883-66d4-46c1-863f-aa020e4da1b8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:06.455714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '787b6ca7d2cc41de912fc3b451025569', 'request_id': 'req-9d371883-66d4-46c1-863f-aa020e4da1b8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:06.468273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] The token cache is being invalidate because project 787b6ca7d2cc41de912fc3b451025569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:13:06.468692 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:06.469612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d371883-66d4-46c1-863f-aa020e4da1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:06.471345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1329/2677] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:13:06 2022] DELETE /identity/v3/projects/787b6ca7d2cc41de912fc3b451025569 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:13:06.477013 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f85541-cbc6-4d8e-8dd1-f73d9b69bb63 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:06.477598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f85541-cbc6-4d8e-8dd1-f73d9b69bb63 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:06.477598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f85541-cbc6-4d8e-8dd1-f73d9b69bb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:06.496778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-23f85541-cbc6-4d8e-8dd1-f73d9b69bb63 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:06.498053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-23f85541-cbc6-4d8e-8dd1-f73d9b69bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:06.514550 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:06.557107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1349/2678] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:06.564991 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf6944-eb36-4a2a-9931-0b4911a5044a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:06.565350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf6944-eb36-4a2a-9931-0b4911a5044a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:06.565628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf6944-eb36-4a2a-9931-0b4911a5044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:06.586159 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-18cf6944-eb36-4a2a-9931-0b4911a5044a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:06.587363 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-18cf6944-eb36-4a2a-9931-0b4911a5044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:06.595360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1330/2679] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:06.599471 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f85541-cbc6-4d8e-8dd1-f73d9b69bb63 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:06.610161 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f85541-cbc6-4d8e-8dd1-f73d9b69bb63 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:06.614734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e801cb-7ea5-4d47-9d84-70684127d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:06.615343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e801cb-7ea5-4d47-9d84-70684127d8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:06.615621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e801cb-7ea5-4d47-9d84-70684127d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:06.615894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e801cb-7ea5-4d47-9d84-70684127d8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:06.616590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e801cb-7ea5-4d47-9d84-70684127d8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:13:06.616922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e801cb-7ea5-4d47-9d84-70684127d8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:06.618546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e801cb-7ea5-4d47-9d84-70684127d8aa admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:06.629782 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1350/2680] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:13:06.634624 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf6944-eb36-4a2a-9931-0b4911a5044a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:06.644167 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf6944-eb36-4a2a-9931-0b4911a5044a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:06.649664 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef1463-3bf5-44a4-9430-63f5cd046b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:06.650268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef1463-3bf5-44a4-9430-63f5cd046b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:06.650554 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef1463-3bf5-44a4-9430-63f5cd046b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:06.650835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef1463-3bf5-44a4-9430-63f5cd046b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:06.651504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef1463-3bf5-44a4-9430-63f5cd046b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:06.653433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef1463-3bf5-44a4-9430-63f5cd046b9a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:06.751401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1331/2681] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:13:06 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:13:06.755560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e801cb-7ea5-4d47-9d84-70684127d8aa admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:06.766213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e801cb-7ea5-4d47-9d84-70684127d8aa admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:06.821084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e346316-c8e3-4624-b215-c2717c0c814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:06.821718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346316-c8e3-4624-b215-c2717c0c814f admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:06.821998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346316-c8e3-4624-b215-c2717c0c814f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:06.822267 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346316-c8e3-4624-b215-c2717c0c814f admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:06.822925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e346316-c8e3-4624-b215-c2717c0c814f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:06.824833 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e346316-c8e3-4624-b215-c2717c0c814f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:06.916545 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1351/2682] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:13:06 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:13:06.920838 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef1463-3bf5-44a4-9430-63f5cd046b9a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:06.931594 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef1463-3bf5-44a4-9430-63f5cd046b9a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:06.936192 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52b1ee-1f69-44ba-ac58-88539ccbd806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:06.936801 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b1ee-1f69-44ba-ac58-88539ccbd806 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:06.937089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b1ee-1f69-44ba-ac58-88539ccbd806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:06.937397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b1ee-1f69-44ba-ac58-88539ccbd806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:06.938089 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52b1ee-1f69-44ba-ac58-88539ccbd806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:06.939684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52b1ee-1f69-44ba-ac58-88539ccbd806 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:06.950126 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1332/2683] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:13:06.953978 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e346316-c8e3-4624-b215-c2717c0c814f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:06.964139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e346316-c8e3-4624-b215-c2717c0c814f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:06.968661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6cdcc-370b-44cd-a6e8-6c7feab0481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:06.969294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6cdcc-370b-44cd-a6e8-6c7feab0481a admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:06.969578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6cdcc-370b-44cd-a6e8-6c7feab0481a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:06.969859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6cdcc-370b-44cd-a6e8-6c7feab0481a admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:06.970546 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6cdcc-370b-44cd-a6e8-6c7feab0481a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:06.972131 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6cdcc-370b-44cd-a6e8-6c7feab0481a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:06.982513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1352/2684] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:13:06.986500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52b1ee-1f69-44ba-ac58-88539ccbd806 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:06.997021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52b1ee-1f69-44ba-ac58-88539ccbd806 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:07.001644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396273e-8da2-4fa2-b8d2-f17d00982f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:07.002294 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396273e-8da2-4fa2-b8d2-f17d00982f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:07.002581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396273e-8da2-4fa2-b8d2-f17d00982f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:07.002857 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396273e-8da2-4fa2-b8d2-f17d00982f4e admin admin] PATH_INFO: `/v3/projects/3520dc1ffe9040bc969cbc3b00052503/users/ec27525586534109b2a6cb617a3d6378/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:07.018154 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396273e-8da2-4fa2-b8d2-f17d00982f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3520dc1ffe9040bc969cbc3b00052503, user_id=ec27525586534109b2a6cb617a3d6378, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:07.020803 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396273e-8da2-4fa2-b8d2-f17d00982f4e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:07.116111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1333/2685] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:13:06 2022] PUT /identity/v3/projects/3520dc1ffe9040bc969cbc3b00052503/users/ec27525586534109b2a6cb617a3d6378/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:13:07.128085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd010b-6983-49d8-9f53-461b3b208545 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:07.128375 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd010b-6983-49d8-9f53-461b3b208545 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:07.128669 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd010b-6983-49d8-9f53-461b3b208545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:07.156658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8fdd010b-6983-49d8-9f53-461b3b208545 None None] MFA Rules not processed for user `ec27525586534109b2a6cb617a3d6378`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:07.157926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8fdd010b-6983-49d8-9f53-461b3b208545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:07.219601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1353/2686] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:07.230210 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396273e-8da2-4fa2-b8d2-f17d00982f4e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:07.231917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1396273e-8da2-4fa2-b8d2-f17d00982f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:07.253881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:07.290389 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396273e-8da2-4fa2-b8d2-f17d00982f4e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:07.294237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6590ca9-0544-4b2b-a272-f6208adde3c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:07.294856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6590ca9-0544-4b2b-a272-f6208adde3c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:07.295136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6590ca9-0544-4b2b-a272-f6208adde3c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:07.295411 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6590ca9-0544-4b2b-a272-f6208adde3c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:07.303762 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6590ca9-0544-4b2b-a272-f6208adde3c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:07.305878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6590ca9-0544-4b2b-a272-f6208adde3c3 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:07.314967 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1334/2687] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:09.225462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4390165-0bbc-420b-820d-648221a9bb74 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:09.226084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4390165-0bbc-420b-820d-648221a9bb74 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:09.226084 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4390165-0bbc-420b-820d-648221a9bb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:09.246544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b4390165-0bbc-420b-820d-648221a9bb74 None None] MFA Rules not processed for user `ec27525586534109b2a6cb617a3d6378`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:09.247761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b4390165-0bbc-420b-820d-648221a9bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:09.255046 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1354/2688] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:17.359059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=17 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:19.240559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:27.998055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce993a-32d6-49d8-8b41-c29ed35c2230 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:27.998578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce993a-32d6-49d8-8b41-c29ed35c2230 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:27.998680 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce993a-32d6-49d8-8b41-c29ed35c2230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:28.018708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-13ce993a-32d6-49d8-8b41-c29ed35c2230 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:28.019904 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-13ce993a-32d6-49d8-8b41-c29ed35c2230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:28.074263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1335/2689] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:13:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:28.239136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4390165-0bbc-420b-820d-648221a9bb74 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:28.240489 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b4390165-0bbc-420b-820d-648221a9bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:28.310609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4390165-0bbc-420b-820d-648221a9bb74 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:28.315550 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652f2fe-b66b-4cf8-a2a6-48cb5e3a6b8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:28.316176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f2fe-b66b-4cf8-a2a6-48cb5e3a6b8c service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:28.316460 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f2fe-b66b-4cf8-a2a6-48cb5e3a6b8c service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:28.316736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f2fe-b66b-4cf8-a2a6-48cb5e3a6b8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:28.324887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652f2fe-b66b-4cf8-a2a6-48cb5e3a6b8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:28.326502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652f2fe-b66b-4cf8-a2a6-48cb5e3a6b8c service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:28.334517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1355/2690] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:13:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:13:29.124957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2069-d1a0-4001-828d-91bab93aae64 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:29.124957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2069-d1a0-4001-828d-91bab93aae64 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:29.124957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2069-d1a0-4001-828d-91bab93aae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:29.140530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1abb2069-d1a0-4001-828d-91bab93aae64 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:29.141750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1abb2069-d1a0-4001-828d-91bab93aae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:29.149981 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1336/2691] 10.222.0.55 () {58 vars in 967 bytes} [Mon Jul 25 23:13:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:29.161941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652f2fe-b66b-4cf8-a2a6-48cb5e3a6b8c service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:29.172382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652f2fe-b66b-4cf8-a2a6-48cb5e3a6b8c service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:29.177516 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76ea09-f6b6-4f3a-aa4f-8a809e5d250c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:29.178120 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76ea09-f6b6-4f3a-aa4f-8a809e5d250c service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:29.178404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76ea09-f6b6-4f3a-aa4f-8a809e5d250c service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:29.178680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76ea09-f6b6-4f3a-aa4f-8a809e5d250c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:29.186631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76ea09-f6b6-4f3a-aa4f-8a809e5d250c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:29.188445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76ea09-f6b6-4f3a-aa4f-8a809e5d250c service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:29.197171 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1356/2692] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:13:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:13:29.828748 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68146deb-f519-4472-a108-490ea715be71 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:29.829032 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68146deb-f519-4472-a108-490ea715be71 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:29.829350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68146deb-f519-4472-a108-490ea715be71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:29.848551 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-68146deb-f519-4472-a108-490ea715be71 None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:29.849778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-68146deb-f519-4472-a108-490ea715be71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:29.857494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1337/2693] 10.222.0.55 () {58 vars in 1009 bytes} [Mon Jul 25 23:13:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:29.870049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76ea09-f6b6-4f3a-aa4f-8a809e5d250c service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:29.880376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76ea09-f6b6-4f3a-aa4f-8a809e5d250c service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:29.885897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c53f4e-9fbf-4eed-bba5-d4ec483932ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:29.886492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c53f4e-9fbf-4eed-bba5-d4ec483932ca service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:29.886769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c53f4e-9fbf-4eed-bba5-d4ec483932ca service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:29.887039 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c53f4e-9fbf-4eed-bba5-d4ec483932ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:29.895053 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c53f4e-9fbf-4eed-bba5-d4ec483932ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:29.896607 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c53f4e-9fbf-4eed-bba5-d4ec483932ca service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:29.904891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1357/2694] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:13:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:13:30.499722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916129b5-a78a-4a7c-8be7-a218071b5ecc None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:30.500183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916129b5-a78a-4a7c-8be7-a218071b5ecc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:30.500286 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916129b5-a78a-4a7c-8be7-a218071b5ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:30.527128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-916129b5-a78a-4a7c-8be7-a218071b5ecc None None] MFA Rules not processed for user `508186f65cac4ab6b4643d0255725c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:30.528335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-916129b5-a78a-4a7c-8be7-a218071b5ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:30.535533 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1338/2695] 10.222.0.55 () {58 vars in 967 bytes} [Mon Jul 25 23:13:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:30.547848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c53f4e-9fbf-4eed-bba5-d4ec483932ca service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:30.558664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c53f4e-9fbf-4eed-bba5-d4ec483932ca service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:30.563668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548670c-b2f8-4df3-a801-2357f40effb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db67b0bfa2a4c0f84fad07ac144b7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:30.564272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548670c-b2f8-4df3-a801-2357f40effb7 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:30.564553 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548670c-b2f8-4df3-a801-2357f40effb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:30.564827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548670c-b2f8-4df3-a801-2357f40effb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:30.574297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548670c-b2f8-4df3-a801-2357f40effb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:30.575866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548670c-b2f8-4df3-a801-2357f40effb7 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:30.583821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1358/2696] 10.222.0.55 () {60 vars in 1384 bytes} [Mon Jul 25 23:13:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:13:33.127566 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916129b5-a78a-4a7c-8be7-a218071b5ecc None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:33.189696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916129b5-a78a-4a7c-8be7-a218071b5ecc None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:33.194306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:33.194876 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:33.195155 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:33.195435 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] PATH_INFO: `/v3/users/ec27525586534109b2a6cb617a3d6378` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:33.196604 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec27525586534109b2a6cb617a3d6378)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:33.198565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:33.374257 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec27525586534109b2a6cb617a3d6378'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:33.374944 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec27525586534109b2a6cb617a3d6378'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:33.435207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec27525586534109b2a6cb617a3d6378'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:33.447780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec27525586534109b2a6cb617a3d6378'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:33.454556 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec27525586534109b2a6cb617a3d6378'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:33.461070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1339/2697] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:13:33 2022] DELETE /identity/v3/users/ec27525586534109b2a6cb617a3d6378 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:13:33.465686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e85e1-d48d-4bb1-9344-8259c1a5fc5e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:33.466144 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e85e1-d48d-4bb1-9344-8259c1a5fc5e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:33.466238 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e85e1-d48d-4bb1-9344-8259c1a5fc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:33.485716 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c67e85e1-d48d-4bb1-9344-8259c1a5fc5e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:33.486936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c67e85e1-d48d-4bb1-9344-8259c1a5fc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:33.544219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1359/2698] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:33.554180 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:33.555579 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:33.562128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:33.611802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab50b01-120e-40f6-93f3-29ede255d6c3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:33.615684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fd9c0-19d9-4b72-b541-6ca29848a9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:33.616493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd9c0-19d9-4b72-b541-6ca29848a9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:33.616631 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd9c0-19d9-4b72-b541-6ca29848a9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:33.616873 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd9c0-19d9-4b72-b541-6ca29848a9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:33.625937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fd9c0-19d9-4b72-b541-6ca29848a9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:33.627369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fd9c0-19d9-4b72-b541-6ca29848a9b9 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:33.637531 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1340/2699] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:33.891425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e85e1-d48d-4bb1-9344-8259c1a5fc5e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:33.893176 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c67e85e1-d48d-4bb1-9344-8259c1a5fc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:33.906676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e85e1-d48d-4bb1-9344-8259c1a5fc5e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:33.911539 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:33.914236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:33.914236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:33.914236 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] PATH_INFO: `/v3/projects/3520dc1ffe9040bc969cbc3b00052503` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:33.914881 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3520dc1ffe9040bc969cbc3b00052503)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:33.916910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:34.013239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:34.015972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3520dc1ffe9040bc969cbc3b00052503', 'request_id': 'req-9ce4a251-8ba4-4746-9190-f7997e6f0b58'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:34.022859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3520dc1ffe9040bc969cbc3b00052503', 'request_id': 'req-9ce4a251-8ba4-4746-9190-f7997e6f0b58'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:34.028333 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3520dc1ffe9040bc969cbc3b00052503', 'request_id': 'req-9ce4a251-8ba4-4746-9190-f7997e6f0b58'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:34.120802 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] The token cache is being invalidate because project 3520dc1ffe9040bc969cbc3b00052503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:13:34.121083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:34.121734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9ce4a251-8ba4-4746-9190-f7997e6f0b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:34.123262 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1360/2700] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:13:33 2022] DELETE /identity/v3/projects/3520dc1ffe9040bc969cbc3b00052503 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:13:34.128111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235f66-11f4-415c-8e9a-85dce235e337 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:34.128595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235f66-11f4-415c-8e9a-85dce235e337 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:34.128705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235f66-11f4-415c-8e9a-85dce235e337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:34.148912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-14235f66-11f4-415c-8e9a-85dce235e337 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:34.150139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-14235f66-11f4-415c-8e9a-85dce235e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:34.207869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1341/2701] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:34.216826 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280bef-7ccf-425d-9af9-28a7cabd51b9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:34.217140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280bef-7ccf-425d-9af9-28a7cabd51b9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:34.217417 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280bef-7ccf-425d-9af9-28a7cabd51b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:34.237244 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9a280bef-7ccf-425d-9af9-28a7cabd51b9 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:34.238431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9a280bef-7ccf-425d-9af9-28a7cabd51b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:34.246562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1361/2702] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:34.250739 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14235f66-11f4-415c-8e9a-85dce235e337 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:34.261169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14235f66-11f4-415c-8e9a-85dce235e337 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:34.265733 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad84b26-2f63-4077-849c-527dd0b2811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:34.266279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84b26-2f63-4077-849c-527dd0b2811e admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:34.266560 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84b26-2f63-4077-849c-527dd0b2811e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:34.266833 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84b26-2f63-4077-849c-527dd0b2811e admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:34.267819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad84b26-2f63-4077-849c-527dd0b2811e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:13:34.268121 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad84b26-2f63-4077-849c-527dd0b2811e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:34.269768 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad84b26-2f63-4077-849c-527dd0b2811e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:34.281756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1342/2703] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:13:34.286165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a280bef-7ccf-425d-9af9-28a7cabd51b9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:34.295448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a280bef-7ccf-425d-9af9-28a7cabd51b9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:34.300085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e9264-4b09-4add-816c-47f5c65ceffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:34.300695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9264-4b09-4add-816c-47f5c65ceffb admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:34.300975 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9264-4b09-4add-816c-47f5c65ceffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:34.301292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9264-4b09-4add-816c-47f5c65ceffb admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:34.301961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e9264-4b09-4add-816c-47f5c65ceffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:34.303890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e9264-4b09-4add-816c-47f5c65ceffb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:34.397100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1362/2704] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:13:34 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:13:34.403125 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad84b26-2f63-4077-849c-527dd0b2811e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:34.413484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad84b26-2f63-4077-849c-527dd0b2811e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:34.470227 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28613564-f04e-4ea9-9ab4-b0e9c526369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:34.470842 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613564-f04e-4ea9-9ab4-b0e9c526369a admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:34.471134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613564-f04e-4ea9-9ab4-b0e9c526369a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:34.471416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613564-f04e-4ea9-9ab4-b0e9c526369a admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:34.472088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28613564-f04e-4ea9-9ab4-b0e9c526369a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:34.474059 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28613564-f04e-4ea9-9ab4-b0e9c526369a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:34.578479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1343/2705] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:13:34 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:13:34.582721 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e9264-4b09-4add-816c-47f5c65ceffb admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:34.594452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e9264-4b09-4add-816c-47f5c65ceffb admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:34.599317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f255f-e7e8-48e0-9d5e-35c451b533b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:34.599921 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f255f-e7e8-48e0-9d5e-35c451b533b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:34.602018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f255f-e7e8-48e0-9d5e-35c451b533b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:34.602018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f255f-e7e8-48e0-9d5e-35c451b533b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:34.602018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f255f-e7e8-48e0-9d5e-35c451b533b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:34.603626 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f255f-e7e8-48e0-9d5e-35c451b533b8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:34.613791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1363/2706] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:13:34.618421 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28613564-f04e-4ea9-9ab4-b0e9c526369a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:34.628481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28613564-f04e-4ea9-9ab4-b0e9c526369a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:34.633314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0677d-e549-4315-b914-4fb582c23026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:34.633916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0677d-e549-4315-b914-4fb582c23026 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:34.634232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0677d-e549-4315-b914-4fb582c23026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:34.640529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0677d-e549-4315-b914-4fb582c23026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:34.640529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0677d-e549-4315-b914-4fb582c23026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:34.640529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0677d-e549-4315-b914-4fb582c23026 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:34.648267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1344/2707] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:13:34.652554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f255f-e7e8-48e0-9d5e-35c451b533b8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:34.662438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f255f-e7e8-48e0-9d5e-35c451b533b8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:34.667762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2b5c-82bc-4f95-acdd-df846210aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:34.668411 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2b5c-82bc-4f95-acdd-df846210aef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:34.668690 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2b5c-82bc-4f95-acdd-df846210aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:34.668981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2b5c-82bc-4f95-acdd-df846210aef7 admin admin] PATH_INFO: `/v3/projects/1527a92c12e34e5f83af323c6d591453/users/38665daca8c344eebac0c659d5195c02/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:34.683982 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c2b5c-82bc-4f95-acdd-df846210aef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1527a92c12e34e5f83af323c6d591453, user_id=38665daca8c344eebac0c659d5195c02, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:34.686647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c2b5c-82bc-4f95-acdd-df846210aef7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:34.784512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1364/2708] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:13:34 2022] PUT /identity/v3/projects/1527a92c12e34e5f83af323c6d591453/users/38665daca8c344eebac0c659d5195c02/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:13:34.795321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb6086-26b1-43f4-8764-da10b12c9a96 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:34.795647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb6086-26b1-43f4-8764-da10b12c9a96 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:34.795924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb6086-26b1-43f4-8764-da10b12c9a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:34.821429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:34.824384 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1ffb6086-26b1-43f4-8764-da10b12c9a96 None None] MFA Rules not processed for user `38665daca8c344eebac0c659d5195c02`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:34.825690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1ffb6086-26b1-43f4-8764-da10b12c9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:34.891337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1345/2709] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:34.902986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2b5c-82bc-4f95-acdd-df846210aef7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:34.904681 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-325c2b5c-82bc-4f95-acdd-df846210aef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:34.960542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2b5c-82bc-4f95-acdd-df846210aef7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:34.965004 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab475939-8af0-4973-b84a-89f735a91748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:34.965646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab475939-8af0-4973-b84a-89f735a91748 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:34.965930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab475939-8af0-4973-b84a-89f735a91748 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:34.966205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab475939-8af0-4973-b84a-89f735a91748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:34.974567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab475939-8af0-4973-b84a-89f735a91748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:34.976099 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab475939-8af0-4973-b84a-89f735a91748 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:34.985387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1365/2710] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:44.888513 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=26 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:44.981445 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:51.871778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb6086-26b1-43f4-8764-da10b12c9a96 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:51.873255 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1ffb6086-26b1-43f4-8764-da10b12c9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:51.930669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb6086-26b1-43f4-8764-da10b12c9a96 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:51.934874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e7fcd-a6f7-43f6-a3b1-6e945734d2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:51.935493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e7fcd-a6f7-43f6-a3b1-6e945734d2bb service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:51.935772 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e7fcd-a6f7-43f6-a3b1-6e945734d2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:51.936044 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e7fcd-a6f7-43f6-a3b1-6e945734d2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:51.937818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e54e7fcd-a6f7-43f6-a3b1-6e945734d2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:52.022777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e7fcd-a6f7-43f6-a3b1-6e945734d2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:52.024291 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e7fcd-a6f7-43f6-a3b1-6e945734d2bb service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:52.045791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1346/2711] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:55.816360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab475939-8af0-4973-b84a-89f735a91748 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:55.881109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab475939-8af0-4973-b84a-89f735a91748 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:55.885639 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:55.886273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:55.886551 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:55.889555 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] PATH_INFO: `/v3/users/38665daca8c344eebac0c659d5195c02` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:55.889555 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38665daca8c344eebac0c659d5195c02)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:55.890639 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:56.077695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38665daca8c344eebac0c659d5195c02'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:56.084588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38665daca8c344eebac0c659d5195c02'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:56.160878 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38665daca8c344eebac0c659d5195c02'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:56.161541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38665daca8c344eebac0c659d5195c02'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:56.162140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38665daca8c344eebac0c659d5195c02'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:56.180804 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1366/2712] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:13:55 2022] DELETE /identity/v3/users/38665daca8c344eebac0c659d5195c02 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:13:56.185524 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b95c5-f400-4ccf-af68-1e6273e41caa None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:56.186043 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b95c5-f400-4ccf-af68-1e6273e41caa None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:56.186153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b95c5-f400-4ccf-af68-1e6273e41caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:56.207303 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-285b95c5-f400-4ccf-af68-1e6273e41caa None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:56.208865 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-285b95c5-f400-4ccf-af68-1e6273e41caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:56.272759 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1347/2713] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:13:56.282809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:56.284219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:56.346208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fe7ba-0f45-43e7-9e98-ed1fa483cf77 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:56.350792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f57de5-14e0-4e7b-b7c4-1a2f71abc040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:56.351610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f57de5-14e0-4e7b-b7c4-1a2f71abc040 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:56.351897 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f57de5-14e0-4e7b-b7c4-1a2f71abc040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:56.352177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f57de5-14e0-4e7b-b7c4-1a2f71abc040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:56.362660 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f57de5-14e0-4e7b-b7c4-1a2f71abc040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:56.364111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f57de5-14e0-4e7b-b7c4-1a2f71abc040 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:56.378925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1367/2714] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:56.851351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b95c5-f400-4ccf-af68-1e6273e41caa None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:56.852819 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-285b95c5-f400-4ccf-af68-1e6273e41caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:56.868297 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b95c5-f400-4ccf-af68-1e6273e41caa None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:56.873561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:56.874203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:56.874481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:56.874755 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] PATH_INFO: `/v3/projects/1527a92c12e34e5f83af323c6d591453` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:56.876994 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1527a92c12e34e5f83af323c6d591453)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:56.878993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:56.896502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:56.978309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1527a92c12e34e5f83af323c6d591453', 'request_id': 'req-9eca7bd6-0970-404f-bafe-afca29250ea9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:56.985238 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1527a92c12e34e5f83af323c6d591453', 'request_id': 'req-9eca7bd6-0970-404f-bafe-afca29250ea9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:57.058062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1527a92c12e34e5f83af323c6d591453', 'request_id': 'req-9eca7bd6-0970-404f-bafe-afca29250ea9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:57.069992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] The token cache is being invalidate because project 1527a92c12e34e5f83af323c6d591453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:13:57.070267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:57.070912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9eca7bd6-0970-404f-bafe-afca29250ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:13:57.072450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1348/2715] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:13:56 2022] DELETE /identity/v3/projects/1527a92c12e34e5f83af323c6d591453 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:13:57.077375 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bf947-c406-4409-b43c-df8e0e2a860a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.077885 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bf947-c406-4409-b43c-df8e0e2a860a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.077980 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bf947-c406-4409-b43c-df8e0e2a860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.097532 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-af4bf947-c406-4409-b43c-df8e0e2a860a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:57.098738 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-af4bf947-c406-4409-b43c-df8e0e2a860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:57.115922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:57.160208 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1368/2716] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:57.168618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa045-fcb5-45c1-8588-3e868548f1cb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.168926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa045-fcb5-45c1-8588-3e868548f1cb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.169259 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa045-fcb5-45c1-8588-3e868548f1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.189790 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-66aaa045-fcb5-45c1-8588-3e868548f1cb None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:57.191019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-66aaa045-fcb5-45c1-8588-3e868548f1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:57.199714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1349/2717] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:57.204308 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bf947-c406-4409-b43c-df8e0e2a860a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:57.214086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bf947-c406-4409-b43c-df8e0e2a860a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:57.219480 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3dab-c7cf-4c6d-a2c0-561046bc9d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:57.220903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3dab-c7cf-4c6d-a2c0-561046bc9d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.220903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3dab-c7cf-4c6d-a2c0-561046bc9d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.220903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3dab-c7cf-4c6d-a2c0-561046bc9d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.221680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3dab-c7cf-4c6d-a2c0-561046bc9d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:13:57.221983 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3dab-c7cf-4c6d-a2c0-561046bc9d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:57.223586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3dab-c7cf-4c6d-a2c0-561046bc9d00 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:57.236387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1369/2718] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:13:57.240880 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaa045-fcb5-45c1-8588-3e868548f1cb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:57.250717 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaa045-fcb5-45c1-8588-3e868548f1cb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:57.255483 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688ee9b-543d-4573-9f12-58b63bc9037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:57.256097 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688ee9b-543d-4573-9f12-58b63bc9037d admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.256386 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688ee9b-543d-4573-9f12-58b63bc9037d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.256661 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688ee9b-543d-4573-9f12-58b63bc9037d admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.257353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688ee9b-543d-4573-9f12-58b63bc9037d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:57.259262 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688ee9b-543d-4573-9f12-58b63bc9037d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:57.357655 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1350/2719] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:13:57 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:13:57.363433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3dab-c7cf-4c6d-a2c0-561046bc9d00 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:57.373810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3dab-c7cf-4c6d-a2c0-561046bc9d00 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:57.433887 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986a908-6c75-4a8f-a601-81ca400af639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:57.434556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986a908-6c75-4a8f-a601-81ca400af639 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.434840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986a908-6c75-4a8f-a601-81ca400af639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.435119 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986a908-6c75-4a8f-a601-81ca400af639 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.435792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986a908-6c75-4a8f-a601-81ca400af639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:57.437797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986a908-6c75-4a8f-a601-81ca400af639 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:57.524550 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1370/2720] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:13:57 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:13:57.529433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688ee9b-543d-4573-9f12-58b63bc9037d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:57.539698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688ee9b-543d-4573-9f12-58b63bc9037d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:57.544705 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2fa7c-237c-48ee-89bc-d3021b0538d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:57.545561 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2fa7c-237c-48ee-89bc-d3021b0538d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.550609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2fa7c-237c-48ee-89bc-d3021b0538d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.550609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2fa7c-237c-48ee-89bc-d3021b0538d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.550609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2fa7c-237c-48ee-89bc-d3021b0538d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:57.550609 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2fa7c-237c-48ee-89bc-d3021b0538d6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:57.558956 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1351/2721] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:13:57.560853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de25ad-8b59-473b-998e-3be2760753d1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.561163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de25ad-8b59-473b-998e-3be2760753d1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.561441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de25ad-8b59-473b-998e-3be2760753d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.562826 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2fa7c-237c-48ee-89bc-d3021b0538d6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:57.573644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2fa7c-237c-48ee-89bc-d3021b0538d6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:57.579459 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4dc21-cbb4-400e-a4a7-6429fd1a8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:57.580106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4dc21-cbb4-400e-a4a7-6429fd1a8726 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.580387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4dc21-cbb4-400e-a4a7-6429fd1a8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.580659 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4dc21-cbb4-400e-a4a7-6429fd1a8726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.581412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4dc21-cbb4-400e-a4a7-6429fd1a8726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:57.581649 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-67de25ad-8b59-473b-998e-3be2760753d1 None None] MFA Rules not processed for user `f54ad4a554de414a80ed03d62c1eb3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:57.582848 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-67de25ad-8b59-473b-998e-3be2760753d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:57.583119 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4dc21-cbb4-400e-a4a7-6429fd1a8726 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:57.594295 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1352/2722] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:13:57.598402 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4dc21-cbb4-400e-a4a7-6429fd1a8726 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:57.608603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4dc21-cbb4-400e-a4a7-6429fd1a8726 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:57.613418 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36dd4-278b-4b7c-9b5c-709314ea3841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:57.614478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36dd4-278b-4b7c-9b5c-709314ea3841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.614478 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36dd4-278b-4b7c-9b5c-709314ea3841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.614777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36dd4-278b-4b7c-9b5c-709314ea3841 admin admin] PATH_INFO: `/v3/projects/4f7847b65ddf4caf9654e3efaba4d4b6/users/b9e8e8827ec3497cb5c71030ba389f99/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.630714 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb36dd4-278b-4b7c-9b5c-709314ea3841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7847b65ddf4caf9654e3efaba4d4b6, user_id=b9e8e8827ec3497cb5c71030ba389f99, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:57.634021 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb36dd4-278b-4b7c-9b5c-709314ea3841 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:57.641270 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1371/2723] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:57.713169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1353/2724] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:13:57 2022] PUT /identity/v3/projects/4f7847b65ddf4caf9654e3efaba4d4b6/users/b9e8e8827ec3497cb5c71030ba389f99/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:13:57.723189 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8886db4-357b-41ba-92eb-20e8bf740006 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.723482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8886db4-357b-41ba-92eb-20e8bf740006 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.723757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8886db4-357b-41ba-92eb-20e8bf740006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.752949 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d8886db4-357b-41ba-92eb-20e8bf740006 None None] MFA Rules not processed for user `b9e8e8827ec3497cb5c71030ba389f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:57.754211 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d8886db4-357b-41ba-92eb-20e8bf740006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:57.787923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:57.821142 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1372/2725] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:13:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:57.832993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36dd4-278b-4b7c-9b5c-709314ea3841 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:57.834821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4cb36dd4-278b-4b7c-9b5c-709314ea3841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:57.900328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36dd4-278b-4b7c-9b5c-709314ea3841 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:57.904177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd69c1-e797-46ec-ae8b-7cb0694ba497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:57.904821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd69c1-e797-46ec-ae8b-7cb0694ba497 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:57.905106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd69c1-e797-46ec-ae8b-7cb0694ba497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:57.905412 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd69c1-e797-46ec-ae8b-7cb0694ba497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:57.914930 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd69c1-e797-46ec-ae8b-7cb0694ba497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:57.916407 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd69c1-e797-46ec-ae8b-7cb0694ba497 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:57.926749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1354/2726] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:58.630027 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8886db4-357b-41ba-92eb-20e8bf740006 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:58.631568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d8886db4-357b-41ba-92eb-20e8bf740006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:58.697421 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8886db4-357b-41ba-92eb-20e8bf740006 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:58.701450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ed53a-6f5e-44a2-87c0-a30175d1287b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:58.702083 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed53a-6f5e-44a2-87c0-a30175d1287b service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:58.702431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed53a-6f5e-44a2-87c0-a30175d1287b service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:58.704852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed53a-6f5e-44a2-87c0-a30175d1287b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:58.704852 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7c0ed53a-6f5e-44a2-87c0-a30175d1287b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:58.797266 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ed53a-6f5e-44a2-87c0-a30175d1287b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:58.801278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ed53a-6f5e-44a2-87c0-a30175d1287b service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:58.809922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1373/2727] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:06.029619 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd69c1-e797-46ec-ae8b-7cb0694ba497 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:06.063891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:06.093140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd69c1-e797-46ec-ae8b-7cb0694ba497 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:06.097682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:06.098314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:06.100945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:06.100945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] PATH_INFO: `/v3/users/b9e8e8827ec3497cb5c71030ba389f99` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:06.100945 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e8e8827ec3497cb5c71030ba389f99)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:06.102080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:06.280185 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e8e8827ec3497cb5c71030ba389f99'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:14:06.280874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e8e8827ec3497cb5c71030ba389f99'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:14:06.346806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e8e8827ec3497cb5c71030ba389f99'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:14:06.359798 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e8e8827ec3497cb5c71030ba389f99'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:14:06.367011 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e8e8827ec3497cb5c71030ba389f99'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:14:06.373767 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1355/2728] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:14:06 2022] DELETE /identity/v3/users/b9e8e8827ec3497cb5c71030ba389f99 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:14:06.378172 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e744c7-edc8-4bd5-961e-5bcc063b80ca None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:06.378600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e744c7-edc8-4bd5-961e-5bcc063b80ca None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:06.379188 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e744c7-edc8-4bd5-961e-5bcc063b80ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:06.398329 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-50e744c7-edc8-4bd5-961e-5bcc063b80ca None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:06.399534 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-50e744c7-edc8-4bd5-961e-5bcc063b80ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:06.457169 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1374/2729] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:06.466837 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:06.468239 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:06.526446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7564e2a-a764-43e6-91b6-bf7521d3b390 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:06.530817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b721e-f50d-4f02-8dbc-6b06cda97834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:06.531428 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b721e-f50d-4f02-8dbc-6b06cda97834 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:06.531712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b721e-f50d-4f02-8dbc-6b06cda97834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:06.531986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b721e-f50d-4f02-8dbc-6b06cda97834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:06.540958 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b721e-f50d-4f02-8dbc-6b06cda97834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:06.542444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b721e-f50d-4f02-8dbc-6b06cda97834 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:06.553200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1356/2730] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:06.954284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e744c7-edc8-4bd5-961e-5bcc063b80ca None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:06.966742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-50e744c7-edc8-4bd5-961e-5bcc063b80ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:06.970537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e744c7-edc8-4bd5-961e-5bcc063b80ca None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:06.975588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:06.976946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:06.977605 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:06.977886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] PATH_INFO: `/v3/projects/4f7847b65ddf4caf9654e3efaba4d4b6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:06.980800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7847b65ddf4caf9654e3efaba4d4b6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:06.982810 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:06.997806 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:07.091402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7847b65ddf4caf9654e3efaba4d4b6', 'request_id': 'req-72471123-4e25-4a1e-8b10-d2dd89723e1d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:14:07.097737 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7847b65ddf4caf9654e3efaba4d4b6', 'request_id': 'req-72471123-4e25-4a1e-8b10-d2dd89723e1d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:14:07.103465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7847b65ddf4caf9654e3efaba4d4b6', 'request_id': 'req-72471123-4e25-4a1e-8b10-d2dd89723e1d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:14:07.180214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] The token cache is being invalidate because project 4f7847b65ddf4caf9654e3efaba4d4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:14:07.180497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:14:07.181102 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-72471123-4e25-4a1e-8b10-d2dd89723e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:14:07.182734 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1375/2731] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:14:06 2022] DELETE /identity/v3/projects/4f7847b65ddf4caf9654e3efaba4d4b6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:14:07.188473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ececf82-514d-4308-a4ce-7f857e98427f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.188946 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ececf82-514d-4308-a4ce-7f857e98427f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.189045 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ececf82-514d-4308-a4ce-7f857e98427f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.333055 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7ececf82-514d-4308-a4ce-7f857e98427f None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:07.334306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7ececf82-514d-4308-a4ce-7f857e98427f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:07.382708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:07.394479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1357/2732] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:07.402178 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16f32b-ab35-4659-968a-d052c866191c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.402686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16f32b-ab35-4659-968a-d052c866191c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.402843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16f32b-ab35-4659-968a-d052c866191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.423207 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-df16f32b-ab35-4659-968a-d052c866191c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:07.424441 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-df16f32b-ab35-4659-968a-d052c866191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:07.432513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1376/2733] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:07.437446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ececf82-514d-4308-a4ce-7f857e98427f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:07.447620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ececf82-514d-4308-a4ce-7f857e98427f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:07.452321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e51bbd-c350-450d-90dc-00c5ecd34e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:07.452928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51bbd-c350-450d-90dc-00c5ecd34e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.453242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51bbd-c350-450d-90dc-00c5ecd34e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.453520 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51bbd-c350-450d-90dc-00c5ecd34e02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.454211 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e51bbd-c350-450d-90dc-00c5ecd34e02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:14:07.454516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e51bbd-c350-450d-90dc-00c5ecd34e02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:07.456133 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e51bbd-c350-450d-90dc-00c5ecd34e02 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:07.468497 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1358/2734] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:14:07.473098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16f32b-ab35-4659-968a-d052c866191c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:07.484113 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16f32b-ab35-4659-968a-d052c866191c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:07.488780 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db3900-cb6b-4ebb-971e-fcc862d4b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:07.489413 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db3900-cb6b-4ebb-971e-fcc862d4b5ca admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.489693 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db3900-cb6b-4ebb-971e-fcc862d4b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.489963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db3900-cb6b-4ebb-971e-fcc862d4b5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.490635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db3900-cb6b-4ebb-971e-fcc862d4b5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:07.492520 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db3900-cb6b-4ebb-971e-fcc862d4b5ca admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:07.607128 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1377/2735] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:14:07 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:14:07.611434 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e51bbd-c350-450d-90dc-00c5ecd34e02 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:07.622850 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e51bbd-c350-450d-90dc-00c5ecd34e02 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:07.678454 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07eeb-3a56-43b6-9b94-60aabc84f898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:07.679062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07eeb-3a56-43b6-9b94-60aabc84f898 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.679342 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07eeb-3a56-43b6-9b94-60aabc84f898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.679613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07eeb-3a56-43b6-9b94-60aabc84f898 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.680273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f07eeb-3a56-43b6-9b94-60aabc84f898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:07.682228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f07eeb-3a56-43b6-9b94-60aabc84f898 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:07.769358 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1359/2736] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:14:07 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:14:07.773528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db3900-cb6b-4ebb-971e-fcc862d4b5ca admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:07.784349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db3900-cb6b-4ebb-971e-fcc862d4b5ca admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:07.788935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3ef40-67a3-4baf-9f89-13d8c9188020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:07.789651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3ef40-67a3-4baf-9f89-13d8c9188020 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.790906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3ef40-67a3-4baf-9f89-13d8c9188020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.790906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3ef40-67a3-4baf-9f89-13d8c9188020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.790906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3ef40-67a3-4baf-9f89-13d8c9188020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:07.792467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3ef40-67a3-4baf-9f89-13d8c9188020 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:07.802904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1378/2737] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:14:07.806741 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07eeb-3a56-43b6-9b94-60aabc84f898 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:07.816677 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07eeb-3a56-43b6-9b94-60aabc84f898 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:07.821351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b619b-81cb-4779-96b2-3560b2c3f740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:07.821957 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b619b-81cb-4779-96b2-3560b2c3f740 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.822238 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b619b-81cb-4779-96b2-3560b2c3f740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.822512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b619b-81cb-4779-96b2-3560b2c3f740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.823203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b619b-81cb-4779-96b2-3560b2c3f740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:07.824806 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b619b-81cb-4779-96b2-3560b2c3f740 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:07.835258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1360/2738] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:14:07.839457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3ef40-67a3-4baf-9f89-13d8c9188020 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:07.850944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3ef40-67a3-4baf-9f89-13d8c9188020 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:07.857479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a502244-a4dd-4a67-b8e5-1b74eaf2b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:07.858353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a502244-a4dd-4a67-b8e5-1b74eaf2b066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.858635 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a502244-a4dd-4a67-b8e5-1b74eaf2b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.858909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a502244-a4dd-4a67-b8e5-1b74eaf2b066 admin admin] PATH_INFO: `/v3/projects/f661a74731894c6e94eced8d8f7520e7/users/c862a035745641b5a8dde92a3d570b35/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.874043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a502244-a4dd-4a67-b8e5-1b74eaf2b066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f661a74731894c6e94eced8d8f7520e7, user_id=c862a035745641b5a8dde92a3d570b35, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:07.876932 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a502244-a4dd-4a67-b8e5-1b74eaf2b066 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:07.949569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1379/2739] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:14:07 2022] PUT /identity/v3/projects/f661a74731894c6e94eced8d8f7520e7/users/c862a035745641b5a8dde92a3d570b35/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:14:07.955348 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f2706-64bf-4773-bfa1-ea8cd918b0da None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.955627 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f2706-64bf-4773-bfa1-ea8cd918b0da None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.955896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f2706-64bf-4773-bfa1-ea8cd918b0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.975273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0f7f2706-64bf-4773-bfa1-ea8cd918b0da None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:07.976482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0f7f2706-64bf-4773-bfa1-ea8cd918b0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:08.034621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1361/2740] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:08.044358 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a502244-a4dd-4a67-b8e5-1b74eaf2b066 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:08.046086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4a502244-a4dd-4a67-b8e5-1b74eaf2b066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:08.101965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a502244-a4dd-4a67-b8e5-1b74eaf2b066 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:08.105620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ddea8-b056-4f2b-9682-ef53094c3993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:08.106348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ddea8-b056-4f2b-9682-ef53094c3993 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:08.106632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ddea8-b056-4f2b-9682-ef53094c3993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:08.106910 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ddea8-b056-4f2b-9682-ef53094c3993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:08.115794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ddea8-b056-4f2b-9682-ef53094c3993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:08.117261 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ddea8-b056-4f2b-9682-ef53094c3993 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:08.126661 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1380/2741] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:14.818111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1821c9-1fc5-462e-9393-bf1641c85c16 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:14.818111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1821c9-1fc5-462e-9393-bf1641c85c16 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:14.818111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1821c9-1fc5-462e-9393-bf1641c85c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:14.862000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2d1821c9-1fc5-462e-9393-bf1641c85c16 None None] MFA Rules not processed for user `c862a035745641b5a8dde92a3d570b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:14.863265 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2d1821c9-1fc5-462e-9393-bf1641c85c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:14.930763 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:14.956107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1362/2742] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:14:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:14.960416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ddea8-b056-4f2b-9682-ef53094c3993 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:14.971506 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ddea8-b056-4f2b-9682-ef53094c3993 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:14.976963 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6906c8-f767-4a4f-b6a7-f335011dc37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:14.977964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6906c8-f767-4a4f-b6a7-f335011dc37c admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:14.978470 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6906c8-f767-4a4f-b6a7-f335011dc37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:14.978967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6906c8-f767-4a4f-b6a7-f335011dc37c admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:14.980111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6906c8-f767-4a4f-b6a7-f335011dc37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:14.982323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6906c8-f767-4a4f-b6a7-f335011dc37c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:15.090969 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1821c9-1fc5-462e-9393-bf1641c85c16 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:15.098254 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1381/2743] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:14:14 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:14:15.104495 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1821c9-1fc5-462e-9393-bf1641c85c16 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:15.180149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708f13-026c-4875-8483-12c446b8299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:15.181797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708f13-026c-4875-8483-12c446b8299e admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:15.182263 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708f13-026c-4875-8483-12c446b8299e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:15.182726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708f13-026c-4875-8483-12c446b8299e admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:15.184132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0708f13-026c-4875-8483-12c446b8299e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:15.186896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0708f13-026c-4875-8483-12c446b8299e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:15.293039 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1363/2744] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:14:15 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:14:15.297633 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6906c8-f767-4a4f-b6a7-f335011dc37c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:15.307840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6906c8-f767-4a4f-b6a7-f335011dc37c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:15.319784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22bb8b-417e-48f5-8886-26c5e94ece8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:15.320579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22bb8b-417e-48f5-8886-26c5e94ece8b admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:15.320935 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22bb8b-417e-48f5-8886-26c5e94ece8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:15.321348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22bb8b-417e-48f5-8886-26c5e94ece8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:15.322184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22bb8b-417e-48f5-8886-26c5e94ece8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:15.323931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22bb8b-417e-48f5-8886-26c5e94ece8b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:15.337050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1382/2745] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:14:15.341919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708f13-026c-4875-8483-12c446b8299e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:15.352643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708f13-026c-4875-8483-12c446b8299e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:15.359458 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfe88d-cb66-4c4d-8b4f-de13f0c87c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:15.360150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfe88d-cb66-4c4d-8b4f-de13f0c87c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:15.360432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfe88d-cb66-4c4d-8b4f-de13f0c87c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:15.360711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfe88d-cb66-4c4d-8b4f-de13f0c87c17 admin admin] PATH_INFO: `/v3/projects/714b0679b7a64ad0b59fe821ba231723/users/5c6a3ea1dd7945d2841ecb0c0d022811/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:15.376704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfe88d-cb66-4c4d-8b4f-de13f0c87c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714b0679b7a64ad0b59fe821ba231723, user_id=5c6a3ea1dd7945d2841ecb0c0d022811, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:15.379445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfe88d-cb66-4c4d-8b4f-de13f0c87c17 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:15.481134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1364/2746] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:14:15 2022] PUT /identity/v3/projects/714b0679b7a64ad0b59fe821ba231723/users/5c6a3ea1dd7945d2841ecb0c0d022811/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:14:15.485214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22bb8b-417e-48f5-8886-26c5e94ece8b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:15.491512 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:15.495353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22bb8b-417e-48f5-8886-26c5e94ece8b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:15.550402 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f545e4f-ea52-409b-926c-0650cacf22aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:15.550940 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545e4f-ea52-409b-926c-0650cacf22aa admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:15.551218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545e4f-ea52-409b-926c-0650cacf22aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:15.551487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545e4f-ea52-409b-926c-0650cacf22aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:15.552163 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f545e4f-ea52-409b-926c-0650cacf22aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:15.553813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f545e4f-ea52-409b-926c-0650cacf22aa admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:15.563425 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1383/2747] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:14:15.567546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfe88d-cb66-4c4d-8b4f-de13f0c87c17 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:15.578171 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfe88d-cb66-4c4d-8b4f-de13f0c87c17 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:15.582832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183a82c-0956-47d7-948c-cae30b136f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:15.583616 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183a82c-0956-47d7-948c-cae30b136f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:15.583728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183a82c-0956-47d7-948c-cae30b136f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:15.584007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183a82c-0956-47d7-948c-cae30b136f35 admin admin] PATH_INFO: `/v3/projects/714b0679b7a64ad0b59fe821ba231723/users/5c6a3ea1dd7945d2841ecb0c0d022811/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:15.586128 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183a82c-0956-47d7-948c-cae30b136f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714b0679b7a64ad0b59fe821ba231723, user_id=5c6a3ea1dd7945d2841ecb0c0d022811, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:15.589165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183a82c-0956-47d7-948c-cae30b136f35 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:15.601367 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1365/2748] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:14:15 2022] PUT /identity/v3/projects/714b0679b7a64ad0b59fe821ba231723/users/5c6a3ea1dd7945d2841ecb0c0d022811/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:14:21.150327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f678-704a-4527-822c-0dba9da27d17 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:21.150327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f678-704a-4527-822c-0dba9da27d17 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:21.150327 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f678-704a-4527-822c-0dba9da27d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:21.179995 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d287f678-704a-4527-822c-0dba9da27d17 None None] MFA Rules not processed for user `5c6a3ea1dd7945d2841ecb0c0d022811`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:21.182174 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d287f678-704a-4527-822c-0dba9da27d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:21.261485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1384/2749] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:14:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:21.276387 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183a82c-0956-47d7-948c-cae30b136f35 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:21.279006 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0183a82c-0956-47d7-948c-cae30b136f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:21.388246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183a82c-0956-47d7-948c-cae30b136f35 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:21.394264 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5d365-ad6d-4cc9-b8dc-2033094a45c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:21.394884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d365-ad6d-4cc9-b8dc-2033094a45c2 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:21.395188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d365-ad6d-4cc9-b8dc-2033094a45c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:21.395461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d365-ad6d-4cc9-b8dc-2033094a45c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:21.438118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:21.455539 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5d365-ad6d-4cc9-b8dc-2033094a45c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:21.457295 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5d365-ad6d-4cc9-b8dc-2033094a45c2 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:21.467398 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1366/2750] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:31.257946 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=61 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:31.500645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=9 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:39.680867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cf43b-65f9-4a43-9874-8cc24885d32f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:39.681397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cf43b-65f9-4a43-9874-8cc24885d32f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:39.681498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cf43b-65f9-4a43-9874-8cc24885d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:39.700106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-055cf43b-65f9-4a43-9874-8cc24885d32f None None] MFA Rules not processed for user `c862a035745641b5a8dde92a3d570b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:39.701579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-055cf43b-65f9-4a43-9874-8cc24885d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:39.708472 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1385/2751] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:14:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:44.148822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5d365-ad6d-4cc9-b8dc-2033094a45c2 service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:44.150456 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-80e5d365-ad6d-4cc9-b8dc-2033094a45c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:44.217093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5d365-ad6d-4cc9-b8dc-2033094a45c2 service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:44.220718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edb373-22a5-40fc-a93e-5358e92215b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:44.221368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edb373-22a5-40fc-a93e-5358e92215b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:44.221646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edb373-22a5-40fc-a93e-5358e92215b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:44.221918 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edb373-22a5-40fc-a93e-5358e92215b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:44.223654 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d1edb373-22a5-40fc-a93e-5358e92215b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:44.233244 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edb373-22a5-40fc-a93e-5358e92215b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:44.234657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edb373-22a5-40fc-a93e-5358e92215b4 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:44.242569 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1367/2752] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:49.694806 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:54.239081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=26 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:58.554264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cf43b-65f9-4a43-9874-8cc24885d32f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:58.564569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cf43b-65f9-4a43-9874-8cc24885d32f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:58.568156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae18371-9633-4be8-9d9f-b24f9c1f4c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:58.568766 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae18371-9633-4be8-9d9f-b24f9c1f4c7e service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:58.569049 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae18371-9633-4be8-9d9f-b24f9c1f4c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:58.569353 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae18371-9633-4be8-9d9f-b24f9c1f4c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:58.579078 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae18371-9633-4be8-9d9f-b24f9c1f4c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:58.580652 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae18371-9633-4be8-9d9f-b24f9c1f4c7e service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:58.590050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1386/2753] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:15:08.585929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:10.836582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be05e30-97fb-441b-979f-9c4df70a533b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:10.837099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be05e30-97fb-441b-979f-9c4df70a533b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:10.837340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be05e30-97fb-441b-979f-9c4df70a533b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:10.856209 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2be05e30-97fb-441b-979f-9c4df70a533b None None] MFA Rules not processed for user `f54ad4a554de414a80ed03d62c1eb3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:15:10.857443 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2be05e30-97fb-441b-979f-9c4df70a533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:15:10.913428 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1368/2754] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:15:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:15:20.906448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=25 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:21.712156 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae18371-9633-4be8-9d9f-b24f9c1f4c7e service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:15:21.724600 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae18371-9633-4be8-9d9f-b24f9c1f4c7e service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:15:21.729993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa88ef-0ee4-4944-abbd-adf0d8901774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:15:21.730592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa88ef-0ee4-4944-abbd-adf0d8901774 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:21.732354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa88ef-0ee4-4944-abbd-adf0d8901774 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:21.732354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa88ef-0ee4-4944-abbd-adf0d8901774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:21.732906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-68aa88ef-0ee4-4944-abbd-adf0d8901774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:15:21.744991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa88ef-0ee4-4944-abbd-adf0d8901774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:15:21.746552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa88ef-0ee4-4944-abbd-adf0d8901774 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:15:21.757562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1387/2755] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:15:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:15:31.753021 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:22.179260 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be05e30-97fb-441b-979f-9c4df70a533b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:22.182319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2be05e30-97fb-441b-979f-9c4df70a533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:22.244057 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be05e30-97fb-441b-979f-9c4df70a533b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:22.248585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:22.249247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:22.249527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:22.249800 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] PATH_INFO: `/v3/users/f54ad4a554de414a80ed03d62c1eb3a5` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:22.250934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54ad4a554de414a80ed03d62c1eb3a5)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:22.252832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:22.441735 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54ad4a554de414a80ed03d62c1eb3a5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:22.442476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54ad4a554de414a80ed03d62c1eb3a5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:22.531038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54ad4a554de414a80ed03d62c1eb3a5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:22.544419 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54ad4a554de414a80ed03d62c1eb3a5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:22.551643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-02fdd3a9-e04c-4aa9-ab61-7fe8ef873160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54ad4a554de414a80ed03d62c1eb3a5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:22.558388 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1369/2756] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:16:22 2022] DELETE /identity/v3/users/f54ad4a554de414a80ed03d62c1eb3a5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:22.794944 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa88ef-0ee4-4944-abbd-adf0d8901774 service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:22.809531 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa88ef-0ee4-4944-abbd-adf0d8901774 service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:22.866742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:22.867389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:22.867674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:22.867951 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] PATH_INFO: `/v3/projects/bca196a6befb4fae9531dc96a1e58d5f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:22.869739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca196a6befb4fae9531dc96a1e58d5f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:22.871644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:22.966299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca196a6befb4fae9531dc96a1e58d5f', 'request_id': 'req-dc55d964-cba5-4cf6-972a-3059949128de'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:22.972316 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca196a6befb4fae9531dc96a1e58d5f', 'request_id': 'req-dc55d964-cba5-4cf6-972a-3059949128de'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:22.977822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca196a6befb4fae9531dc96a1e58d5f', 'request_id': 'req-dc55d964-cba5-4cf6-972a-3059949128de'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:23.046467 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] The token cache is being invalidate because project bca196a6befb4fae9531dc96a1e58d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:16:23.046693 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:23.047335 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc55d964-cba5-4cf6-972a-3059949128de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:23.048906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1388/2757] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:16:22 2022] DELETE /identity/v3/projects/bca196a6befb4fae9531dc96a1e58d5f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:23.054038 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ff1ab-9290-4040-a663-e37a2bebfd17 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:23.054331 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ff1ab-9290-4040-a663-e37a2bebfd17 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:23.054611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ff1ab-9290-4040-a663-e37a2bebfd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:23.074314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-148ff1ab-9290-4040-a663-e37a2bebfd17 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:23.075530 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-148ff1ab-9290-4040-a663-e37a2bebfd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:23.133710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1370/2758] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:23.142146 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c727-f125-4c46-bbb2-fceb7fd9c5ba None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:23.142436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c727-f125-4c46-bbb2-fceb7fd9c5ba None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:23.142714 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c727-f125-4c46-bbb2-fceb7fd9c5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:23.162233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-cc03c727-f125-4c46-bbb2-fceb7fd9c5ba None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:23.163433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cc03c727-f125-4c46-bbb2-fceb7fd9c5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:23.172058 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1389/2759] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:23.176157 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ff1ab-9290-4040-a663-e37a2bebfd17 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:23.186308 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ff1ab-9290-4040-a663-e37a2bebfd17 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:23.190872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3e209-f580-4576-a355-c006967e94d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:23.191475 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3e209-f580-4576-a355-c006967e94d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:23.191758 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3e209-f580-4576-a355-c006967e94d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:23.192034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3e209-f580-4576-a355-c006967e94d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:23.192725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3e209-f580-4576-a355-c006967e94d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:16:23.193063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3e209-f580-4576-a355-c006967e94d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:23.194690 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3e209-f580-4576-a355-c006967e94d7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:23.205854 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1371/2760] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:16:23.209996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c727-f125-4c46-bbb2-fceb7fd9c5ba None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:23.219109 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c727-f125-4c46-bbb2-fceb7fd9c5ba None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:23.224009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83751380-209e-47a4-a7fd-89b642012839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:23.224620 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751380-209e-47a4-a7fd-89b642012839 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:23.224906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751380-209e-47a4-a7fd-89b642012839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:23.225229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751380-209e-47a4-a7fd-89b642012839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:23.225903 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83751380-209e-47a4-a7fd-89b642012839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:23.227864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83751380-209e-47a4-a7fd-89b642012839 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:23.334643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1390/2761] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:16:23 2022] POST /identity/v3/projects => generated 357 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:16:23.339206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3e209-f580-4576-a355-c006967e94d7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:23.349453 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3e209-f580-4576-a355-c006967e94d7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:23.352973 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:23.406722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff70e1-1cc4-4e90-9466-050832b28396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:23.407335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff70e1-1cc4-4e90-9466-050832b28396 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:23.407620 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff70e1-1cc4-4e90-9466-050832b28396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:23.407896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff70e1-1cc4-4e90-9466-050832b28396 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:23.408593 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff70e1-1cc4-4e90-9466-050832b28396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:23.410581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff70e1-1cc4-4e90-9466-050832b28396 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:23.487019 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1372/2762] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:16:23 2022] POST /identity/v3/users => generated 279 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:16:23.491292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83751380-209e-47a4-a7fd-89b642012839 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:23.501844 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83751380-209e-47a4-a7fd-89b642012839 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:23.506556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974cef8-3791-4ba9-aed9-15579d6ecd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:23.507165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974cef8-3791-4ba9-aed9-15579d6ecd62 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:23.507450 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974cef8-3791-4ba9-aed9-15579d6ecd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:23.507732 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974cef8-3791-4ba9-aed9-15579d6ecd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:23.508492 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974cef8-3791-4ba9-aed9-15579d6ecd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:23.510179 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974cef8-3791-4ba9-aed9-15579d6ecd62 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:23.520469 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1391/2763] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:23.524344 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff70e1-1cc4-4e90-9466-050832b28396 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:23.534993 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff70e1-1cc4-4e90-9466-050832b28396 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:23.539727 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5d85f-7ec5-42af-981f-0d3e87149b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:23.540320 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5d85f-7ec5-42af-981f-0d3e87149b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:23.540601 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5d85f-7ec5-42af-981f-0d3e87149b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:23.540882 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5d85f-7ec5-42af-981f-0d3e87149b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:23.541610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5d85f-7ec5-42af-981f-0d3e87149b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:23.543877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5d85f-7ec5-42af-981f-0d3e87149b7d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:23.554207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1373/2764] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:23.558397 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974cef8-3791-4ba9-aed9-15579d6ecd62 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:23.568278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974cef8-3791-4ba9-aed9-15579d6ecd62 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:23.572934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0659788-2444-4f58-951c-3130564ebc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:23.573761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0659788-2444-4f58-951c-3130564ebc82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:23.579556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0659788-2444-4f58-951c-3130564ebc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:23.579556 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0659788-2444-4f58-951c-3130564ebc82 admin admin] PATH_INFO: `/v3/projects/1449f429018c47dd8afd33e7ca4c5724/users/f553fd7a35cf481eac7f24d7f4f87f39/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:23.590643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0659788-2444-4f58-951c-3130564ebc82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1449f429018c47dd8afd33e7ca4c5724, user_id=f553fd7a35cf481eac7f24d7f4f87f39, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:23.593273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0659788-2444-4f58-951c-3130564ebc82 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:23.679138 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1392/2765] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:16:23 2022] PUT /identity/v3/projects/1449f429018c47dd8afd33e7ca4c5724/users/f553fd7a35cf481eac7f24d7f4f87f39/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:23.690493 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021862d-cae8-459b-a275-323f629281ca None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:23.692312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021862d-cae8-459b-a275-323f629281ca None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:23.692312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021862d-cae8-459b-a275-323f629281ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:23.721092 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6021862d-cae8-459b-a275-323f629281ca None None] MFA Rules not processed for user `f553fd7a35cf481eac7f24d7f4f87f39`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:23.726715 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6021862d-cae8-459b-a275-323f629281ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:23.785527 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1374/2766] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:23 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:23.790048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0659788-2444-4f58-951c-3130564ebc82 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:23.819217 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:23.853656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0659788-2444-4f58-951c-3130564ebc82 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:23.859123 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fe32c-b551-449e-a959-cc19f247d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:23.859836 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe32c-b551-449e-a959-cc19f247d8fd admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:23.860018 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe32c-b551-449e-a959-cc19f247d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:23.860293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe32c-b551-449e-a959-cc19f247d8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:23.860969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fe32c-b551-449e-a959-cc19f247d8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:23.862936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fe32c-b551-449e-a959-cc19f247d8fd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:23.961051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1393/2767] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:16:23 2022] POST /identity/v3/projects => generated 351 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:16:23.966004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021862d-cae8-459b-a275-323f629281ca None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:23.976909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021862d-cae8-459b-a275-323f629281ca None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:24.036642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cac85-c1f6-4919-9b70-6ebb1e06b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:24.037287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cac85-c1f6-4919-9b70-6ebb1e06b582 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:24.037571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cac85-c1f6-4919-9b70-6ebb1e06b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:24.037849 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cac85-c1f6-4919-9b70-6ebb1e06b582 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:24.038504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cac85-c1f6-4919-9b70-6ebb1e06b582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:24.040417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cac85-c1f6-4919-9b70-6ebb1e06b582 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:24.154557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1375/2768] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:16:23 2022] POST /identity/v3/users => generated 282 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:16:24.158669 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fe32c-b551-449e-a959-cc19f247d8fd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:24.169829 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fe32c-b551-449e-a959-cc19f247d8fd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:24.174562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf341243-a643-4d6c-83a6-ccedab8c6163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:24.175246 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341243-a643-4d6c-83a6-ccedab8c6163 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:24.175526 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341243-a643-4d6c-83a6-ccedab8c6163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:24.175821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341243-a643-4d6c-83a6-ccedab8c6163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:24.176519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf341243-a643-4d6c-83a6-ccedab8c6163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:24.178257 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf341243-a643-4d6c-83a6-ccedab8c6163 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:24.189366 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1394/2769] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:16:24.193689 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cac85-c1f6-4919-9b70-6ebb1e06b582 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:24.200391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:24.204722 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cac85-c1f6-4919-9b70-6ebb1e06b582 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:24.209571 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbabee-902f-4455-b061-d6bd253a018b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:24.211778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbabee-902f-4455-b061-d6bd253a018b admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:24.211778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbabee-902f-4455-b061-d6bd253a018b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:24.211778 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbabee-902f-4455-b061-d6bd253a018b admin admin] PATH_INFO: `/v3/projects/435224bd23b84728a7f5bd3c1a791230/users/9fd751b0c5954b89836d53c27e9ba9cc/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:24.227169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbabee-902f-4455-b061-d6bd253a018b admin admin] RBAC: Authorizing `identity:create_grant(project_id=435224bd23b84728a7f5bd3c1a791230, user_id=9fd751b0c5954b89836d53c27e9ba9cc, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:24.230612 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbabee-902f-4455-b061-d6bd253a018b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:24.293989 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1376/2770] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:16:24 2022] PUT /identity/v3/projects/435224bd23b84728a7f5bd3c1a791230/users/9fd751b0c5954b89836d53c27e9ba9cc/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:24.298203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf341243-a643-4d6c-83a6-ccedab8c6163 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:24.308407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf341243-a643-4d6c-83a6-ccedab8c6163 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:24.368436 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dbcf6-3702-4cc1-920c-cc7ba334a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:24.369066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dbcf6-3702-4cc1-920c-cc7ba334a98e admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:24.369385 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dbcf6-3702-4cc1-920c-cc7ba334a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:24.369674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dbcf6-3702-4cc1-920c-cc7ba334a98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:24.370442 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dbcf6-3702-4cc1-920c-cc7ba334a98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:24.372093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dbcf6-3702-4cc1-920c-cc7ba334a98e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:24.382438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1395/2771] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:24.387432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbabee-902f-4455-b061-d6bd253a018b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:24.402446 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbabee-902f-4455-b061-d6bd253a018b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:24.413813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995710a4-df5a-4551-9982-740baeda6831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:24.413813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995710a4-df5a-4551-9982-740baeda6831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:24.413813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995710a4-df5a-4551-9982-740baeda6831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:24.413813 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995710a4-df5a-4551-9982-740baeda6831 admin admin] PATH_INFO: `/v3/projects/435224bd23b84728a7f5bd3c1a791230/users/9fd751b0c5954b89836d53c27e9ba9cc/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:24.414335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995710a4-df5a-4551-9982-740baeda6831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435224bd23b84728a7f5bd3c1a791230, user_id=9fd751b0c5954b89836d53c27e9ba9cc, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:24.414335 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995710a4-df5a-4551-9982-740baeda6831 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:24.427761 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1377/2772] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:16:24 2022] PUT /identity/v3/projects/435224bd23b84728a7f5bd3c1a791230/users/9fd751b0c5954b89836d53c27e9ba9cc/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:24.438841 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268c6ca-7cad-4c5d-8ac9-2f6b3f4f943b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:24.439135 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268c6ca-7cad-4c5d-8ac9-2f6b3f4f943b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:24.439419 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268c6ca-7cad-4c5d-8ac9-2f6b3f4f943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:24.469875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d268c6ca-7cad-4c5d-8ac9-2f6b3f4f943b None None] MFA Rules not processed for user `9fd751b0c5954b89836d53c27e9ba9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:24.471106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d268c6ca-7cad-4c5d-8ac9-2f6b3f4f943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:24.543433 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1396/2773] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:24 2022] POST /identity/v3/auth/tokens => generated 3285 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:24.556438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995710a4-df5a-4551-9982-740baeda6831 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:24.558369 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-995710a4-df5a-4551-9982-740baeda6831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:24.621522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995710a4-df5a-4551-9982-740baeda6831 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:24.626339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81990ea2-9b29-497a-ac3a-f1b932ca8000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:24.626948 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990ea2-9b29-497a-ac3a-f1b932ca8000 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:24.627222 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990ea2-9b29-497a-ac3a-f1b932ca8000 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:24.627489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990ea2-9b29-497a-ac3a-f1b932ca8000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:24.637610 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81990ea2-9b29-497a-ac3a-f1b932ca8000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:24.639517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81990ea2-9b29-497a-ac3a-f1b932ca8000 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:24.649472 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1378/2774] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:24 2022] GET /identity/v3/auth/tokens => generated 3285 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:16:24.860347 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268c6ca-7cad-4c5d-8ac9-2f6b3f4f943b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:24.870705 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268c6ca-7cad-4c5d-8ac9-2f6b3f4f943b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:24.874245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a60dcf-c5aa-43ab-9ac3-1057a4a5b55d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:24.874875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60dcf-c5aa-43ab-9ac3-1057a4a5b55d service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:24.876105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60dcf-c5aa-43ab-9ac3-1057a4a5b55d service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:24.876105 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60dcf-c5aa-43ab-9ac3-1057a4a5b55d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:24.896981 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:24.934462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a60dcf-c5aa-43ab-9ac3-1057a4a5b55d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:24.936017 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a60dcf-c5aa-43ab-9ac3-1057a4a5b55d service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:24.945867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1397/2775] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:24 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:16:34.644776 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:34.955447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=18 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:43.268101 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81990ea2-9b29-497a-ac3a-f1b932ca8000 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:43.330093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81990ea2-9b29-497a-ac3a-f1b932ca8000 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:43.334542 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:43.335169 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:43.335448 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:43.335721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] PATH_INFO: `/v3/users/f553fd7a35cf481eac7f24d7f4f87f39` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:43.336851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f553fd7a35cf481eac7f24d7f4f87f39)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:43.338808 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:43.477037 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f553fd7a35cf481eac7f24d7f4f87f39'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:43.477632 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f553fd7a35cf481eac7f24d7f4f87f39'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:43.526118 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f553fd7a35cf481eac7f24d7f4f87f39'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:43.538771 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f553fd7a35cf481eac7f24d7f4f87f39'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:43.546574 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f553fd7a35cf481eac7f24d7f4f87f39'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:43.552435 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1379/2776] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:16:43 2022] DELETE /identity/v3/users/f553fd7a35cf481eac7f24d7f4f87f39 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:43.556894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb5ca-afd1-48d3-ac5a-8fd393312571 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:43.557418 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb5ca-afd1-48d3-ac5a-8fd393312571 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:43.557533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb5ca-afd1-48d3-ac5a-8fd393312571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:43.576495 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f17cb5ca-afd1-48d3-ac5a-8fd393312571 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:43.578479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f17cb5ca-afd1-48d3-ac5a-8fd393312571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:43.635567 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1398/2777] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:43.646029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:43.647403 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:43.703994 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0e531-f1d2-4e54-85d8-084e10170361 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:43.707622 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad02a6-7314-4f92-b1fa-7765c614f116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:43.708238 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad02a6-7314-4f92-b1fa-7765c614f116 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:43.708516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad02a6-7314-4f92-b1fa-7765c614f116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:43.708788 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad02a6-7314-4f92-b1fa-7765c614f116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:43.718224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad02a6-7314-4f92-b1fa-7765c614f116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:43.719718 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad02a6-7314-4f92-b1fa-7765c614f116 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:43.729075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1380/2778] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:16:44.131805 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cb5ca-afd1-48d3-ac5a-8fd393312571 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:44.133540 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f17cb5ca-afd1-48d3-ac5a-8fd393312571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:44.149317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cb5ca-afd1-48d3-ac5a-8fd393312571 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:44.155129 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:44.155821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:44.156101 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:44.156374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] PATH_INFO: `/v3/projects/1449f429018c47dd8afd33e7ca4c5724` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:44.157554 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1449f429018c47dd8afd33e7ca4c5724)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:44.159524 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:44.337991 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1449f429018c47dd8afd33e7ca4c5724', 'request_id': 'req-1aa3d602-6dfc-4f42-8556-658ff6ef7036'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:44.345015 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1449f429018c47dd8afd33e7ca4c5724', 'request_id': 'req-1aa3d602-6dfc-4f42-8556-658ff6ef7036'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:44.355891 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1449f429018c47dd8afd33e7ca4c5724', 'request_id': 'req-1aa3d602-6dfc-4f42-8556-658ff6ef7036'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:44.463233 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] The token cache is being invalidate because project 1449f429018c47dd8afd33e7ca4c5724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:16:44.463525 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:44.464132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:44.466286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1399/2779] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:16:44 2022] DELETE /identity/v3/projects/1449f429018c47dd8afd33e7ca4c5724 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:44.470232 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad02a6-7314-4f92-b1fa-7765c614f116 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:44.479756 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad02a6-7314-4f92-b1fa-7765c614f116 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:44.498395 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:44.536691 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:44.537380 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:44.537662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:44.537982 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] PATH_INFO: `/v3/users/9fd751b0c5954b89836d53c27e9ba9cc` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:44.539269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd751b0c5954b89836d53c27e9ba9cc)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:44.541378 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:44.763796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd751b0c5954b89836d53c27e9ba9cc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:44.764711 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd751b0c5954b89836d53c27e9ba9cc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:44.823597 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd751b0c5954b89836d53c27e9ba9cc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:44.836309 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd751b0c5954b89836d53c27e9ba9cc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:44.844669 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-131ff81b-d369-42b6-adad-3ebc1425368f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd751b0c5954b89836d53c27e9ba9cc'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:44.850853 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1381/2780] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:16:44 2022] DELETE /identity/v3/users/9fd751b0c5954b89836d53c27e9ba9cc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:45.237741 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:45.242448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:45.253294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3d602-6dfc-4f42-8556-658ff6ef7036 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:45.311923 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:45.312499 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:45.312778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:45.313050 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] PATH_INFO: `/v3/projects/435224bd23b84728a7f5bd3c1a791230` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:45.314222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435224bd23b84728a7f5bd3c1a791230)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:45.316125 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:45.394678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:45.411147 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435224bd23b84728a7f5bd3c1a791230', 'request_id': 'req-110b0840-9aad-4114-be7d-a3eadcef2ae4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:45.417390 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435224bd23b84728a7f5bd3c1a791230', 'request_id': 'req-110b0840-9aad-4114-be7d-a3eadcef2ae4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:45.423479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435224bd23b84728a7f5bd3c1a791230', 'request_id': 'req-110b0840-9aad-4114-be7d-a3eadcef2ae4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:45.501355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] The token cache is being invalidate because project 435224bd23b84728a7f5bd3c1a791230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:16:45.501640 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:45.502476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-110b0840-9aad-4114-be7d-a3eadcef2ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:45.504035 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1400/2781] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:16:45 2022] DELETE /identity/v3/projects/435224bd23b84728a7f5bd3c1a791230 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:45.508920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf3e10-6b05-406a-9d12-5a725965e192 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:45.509432 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf3e10-6b05-406a-9d12-5a725965e192 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:45.509540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf3e10-6b05-406a-9d12-5a725965e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:45.529166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-95cf3e10-6b05-406a-9d12-5a725965e192 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:45.530362 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-95cf3e10-6b05-406a-9d12-5a725965e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:45.588817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1382/2782] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:45.651911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963bdb-ccc8-480f-8c26-1207f3c9bc6a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:45.652214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963bdb-ccc8-480f-8c26-1207f3c9bc6a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:45.652477 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963bdb-ccc8-480f-8c26-1207f3c9bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:45.674164 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0d963bdb-ccc8-480f-8c26-1207f3c9bc6a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:45.675371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0d963bdb-ccc8-480f-8c26-1207f3c9bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:45.683253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1401/2783] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:45.688153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf3e10-6b05-406a-9d12-5a725965e192 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:45.697749 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf3e10-6b05-406a-9d12-5a725965e192 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:45.702708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034f456-eec1-4c02-8231-a942da3856ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:45.703359 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f456-eec1-4c02-8231-a942da3856ec admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:45.703645 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f456-eec1-4c02-8231-a942da3856ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:45.703921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f456-eec1-4c02-8231-a942da3856ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:45.704618 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034f456-eec1-4c02-8231-a942da3856ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:16:45.704921 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034f456-eec1-4c02-8231-a942da3856ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:45.706702 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034f456-eec1-4c02-8231-a942da3856ec admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:45.718984 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1383/2784] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:16:45.723296 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963bdb-ccc8-480f-8c26-1207f3c9bc6a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:45.733422 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963bdb-ccc8-480f-8c26-1207f3c9bc6a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:45.738107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01afbf1-a900-4e56-b8e2-451485cb729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:45.738708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01afbf1-a900-4e56-b8e2-451485cb729a admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:45.738993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01afbf1-a900-4e56-b8e2-451485cb729a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:45.739264 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01afbf1-a900-4e56-b8e2-451485cb729a admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:45.739920 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01afbf1-a900-4e56-b8e2-451485cb729a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:45.741873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01afbf1-a900-4e56-b8e2-451485cb729a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:45.864230 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1402/2785] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:16:45 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:16:45.868433 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034f456-eec1-4c02-8231-a942da3856ec admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:45.878603 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034f456-eec1-4c02-8231-a942da3856ec admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:45.906274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:45.937251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268b6ba-2569-4c48-906f-5b55791b6e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:45.937866 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268b6ba-2569-4c48-906f-5b55791b6e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:45.938149 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268b6ba-2569-4c48-906f-5b55791b6e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:45.938426 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268b6ba-2569-4c48-906f-5b55791b6e79 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:45.939096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268b6ba-2569-4c48-906f-5b55791b6e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:45.941642 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268b6ba-2569-4c48-906f-5b55791b6e79 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:46.022672 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1384/2786] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:16:45 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:16:46.026808 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01afbf1-a900-4e56-b8e2-451485cb729a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:46.037800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01afbf1-a900-4e56-b8e2-451485cb729a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:46.043663 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892663c-9414-4cd8-b36e-193cc6c09e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:46.044294 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892663c-9414-4cd8-b36e-193cc6c09e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:46.044578 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892663c-9414-4cd8-b36e-193cc6c09e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:46.044849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892663c-9414-4cd8-b36e-193cc6c09e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:46.045584 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892663c-9414-4cd8-b36e-193cc6c09e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:46.047237 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892663c-9414-4cd8-b36e-193cc6c09e9b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:46.058061 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1403/2787] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:46.062721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268b6ba-2569-4c48-906f-5b55791b6e79 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:46.073075 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268b6ba-2569-4c48-906f-5b55791b6e79 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:46.078730 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545a6a-ea11-4774-a593-1110ac7ed396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:46.079338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545a6a-ea11-4774-a593-1110ac7ed396 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:46.079621 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545a6a-ea11-4774-a593-1110ac7ed396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:46.079896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545a6a-ea11-4774-a593-1110ac7ed396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:46.080589 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545a6a-ea11-4774-a593-1110ac7ed396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:46.082230 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545a6a-ea11-4774-a593-1110ac7ed396 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:46.094148 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1385/2788] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:46.098541 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892663c-9414-4cd8-b36e-193cc6c09e9b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:46.109151 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892663c-9414-4cd8-b36e-193cc6c09e9b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:46.113883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191c4ee-c78d-4e26-aefe-baca7537af35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:46.114482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191c4ee-c78d-4e26-aefe-baca7537af35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:46.114762 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191c4ee-c78d-4e26-aefe-baca7537af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:46.115034 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191c4ee-c78d-4e26-aefe-baca7537af35 admin admin] PATH_INFO: `/v3/projects/ea2c68f6e02a4fc983f8632480ac75b3/users/0f25a5d57f154214a03200b4014fb6d6/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:46.130203 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191c4ee-c78d-4e26-aefe-baca7537af35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2c68f6e02a4fc983f8632480ac75b3, user_id=0f25a5d57f154214a03200b4014fb6d6, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:46.132911 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191c4ee-c78d-4e26-aefe-baca7537af35 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:46.245202 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1404/2789] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:16:46 2022] PUT /identity/v3/projects/ea2c68f6e02a4fc983f8632480ac75b3/users/0f25a5d57f154214a03200b4014fb6d6/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:46.263764 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbea57-c54b-483a-b253-bf62502bc857 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:46.264338 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbea57-c54b-483a-b253-bf62502bc857 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:46.264611 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbea57-c54b-483a-b253-bf62502bc857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:46.298383 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-01cbea57-c54b-483a-b253-bf62502bc857 None None] MFA Rules not processed for user `0f25a5d57f154214a03200b4014fb6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:46.299643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-01cbea57-c54b-483a-b253-bf62502bc857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:46.363143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1386/2790] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:16:46.367792 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191c4ee-c78d-4e26-aefe-baca7537af35 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:46.431132 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191c4ee-c78d-4e26-aefe-baca7537af35 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:46.436549 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669bddb-6c54-4282-ac22-e85f4ed9b407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:46.437200 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669bddb-6c54-4282-ac22-e85f4ed9b407 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:46.437490 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669bddb-6c54-4282-ac22-e85f4ed9b407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:46.437770 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669bddb-6c54-4282-ac22-e85f4ed9b407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:46.438446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669bddb-6c54-4282-ac22-e85f4ed9b407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:46.440383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669bddb-6c54-4282-ac22-e85f4ed9b407 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:46.541846 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1405/2791] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:16:46 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:16:46.545840 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbea57-c54b-483a-b253-bf62502bc857 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:46.557070 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbea57-c54b-483a-b253-bf62502bc857 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:46.617279 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cb772-cc57-4ba2-a4c1-69960f82d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:46.617941 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cb772-cc57-4ba2-a4c1-69960f82d4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:46.618165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cb772-cc57-4ba2-a4c1-69960f82d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:46.618438 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cb772-cc57-4ba2-a4c1-69960f82d4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:46.619093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cb772-cc57-4ba2-a4c1-69960f82d4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:46.621018 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cb772-cc57-4ba2-a4c1-69960f82d4a9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:46.698425 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1387/2792] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:16:46 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:16:46.702930 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669bddb-6c54-4282-ac22-e85f4ed9b407 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:46.720787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669bddb-6c54-4282-ac22-e85f4ed9b407 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:46.725494 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d9ced-f8f8-45ce-b422-d1b86d5f6b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:46.726127 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9ced-f8f8-45ce-b422-d1b86d5f6b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:46.726407 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9ced-f8f8-45ce-b422-d1b86d5f6b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:46.726678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9ced-f8f8-45ce-b422-d1b86d5f6b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:46.727401 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d9ced-f8f8-45ce-b422-d1b86d5f6b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:46.729009 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d9ced-f8f8-45ce-b422-d1b86d5f6b02 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:46.741502 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1406/2793] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:46.745829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cb772-cc57-4ba2-a4c1-69960f82d4a9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:46.756161 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cb772-cc57-4ba2-a4c1-69960f82d4a9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:46.760933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b64da-b2e9-4b7c-90d9-6a7939ba14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:46.762069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b64da-b2e9-4b7c-90d9-6a7939ba14a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:46.762069 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b64da-b2e9-4b7c-90d9-6a7939ba14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:46.762663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b64da-b2e9-4b7c-90d9-6a7939ba14a1 admin admin] PATH_INFO: `/v3/projects/fe1a63d3806148aabf0566d7f63bdba0/users/37505eb2572b48b182a1f8cc06ffcf74/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:46.781047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b64da-b2e9-4b7c-90d9-6a7939ba14a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1a63d3806148aabf0566d7f63bdba0, user_id=37505eb2572b48b182a1f8cc06ffcf74, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:46.783815 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b64da-b2e9-4b7c-90d9-6a7939ba14a1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:46.849096 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1388/2794] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:16:46 2022] PUT /identity/v3/projects/fe1a63d3806148aabf0566d7f63bdba0/users/37505eb2572b48b182a1f8cc06ffcf74/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:16:46.853429 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d9ced-f8f8-45ce-b422-d1b86d5f6b02 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:46.864608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d9ced-f8f8-45ce-b422-d1b86d5f6b02 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:46.885275 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:46.927637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9741c-c436-4ba4-a7bb-cbdbda354902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:46.928289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9741c-c436-4ba4-a7bb-cbdbda354902 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:46.928568 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9741c-c436-4ba4-a7bb-cbdbda354902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:46.928840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9741c-c436-4ba4-a7bb-cbdbda354902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:46.929573 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9741c-c436-4ba4-a7bb-cbdbda354902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:46.931221 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9741c-c436-4ba4-a7bb-cbdbda354902 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:46.945610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1407/2795] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:46.951328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b64da-b2e9-4b7c-90d9-6a7939ba14a1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:46.958486 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:46.964203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b64da-b2e9-4b7c-90d9-6a7939ba14a1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:46.971240 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6291b-c6f2-4b57-a3b2-47887b42e0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:46.971949 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6291b-c6f2-4b57-a3b2-47887b42e0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:46.972224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6291b-c6f2-4b57-a3b2-47887b42e0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:46.972494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6291b-c6f2-4b57-a3b2-47887b42e0c1 admin admin] PATH_INFO: `/v3/projects/fe1a63d3806148aabf0566d7f63bdba0/users/37505eb2572b48b182a1f8cc06ffcf74/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:46.974504 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6291b-c6f2-4b57-a3b2-47887b42e0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1a63d3806148aabf0566d7f63bdba0, user_id=37505eb2572b48b182a1f8cc06ffcf74, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:46.977700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6291b-c6f2-4b57-a3b2-47887b42e0c1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:46.990268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1389/2796] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:16:46 2022] PUT /identity/v3/projects/fe1a63d3806148aabf0566d7f63bdba0/users/37505eb2572b48b182a1f8cc06ffcf74/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:16:47.001706 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4632aa-c167-412e-8001-9304fd72c759 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:47.001993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4632aa-c167-412e-8001-9304fd72c759 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:47.002269 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4632aa-c167-412e-8001-9304fd72c759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:47.034964 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8e4632aa-c167-412e-8001-9304fd72c759 None None] MFA Rules not processed for user `37505eb2572b48b182a1f8cc06ffcf74`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:47.036212 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8e4632aa-c167-412e-8001-9304fd72c759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:47.117867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1408/2797] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:47.129041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6291b-c6f2-4b57-a3b2-47887b42e0c1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:47.130783 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-03e6291b-c6f2-4b57-a3b2-47887b42e0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:47.195812 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6291b-c6f2-4b57-a3b2-47887b42e0c1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:47.200687 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b7897-83d1-4438-a062-053dabfc6bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:47.201355 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b7897-83d1-4438-a062-053dabfc6bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:47.201643 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b7897-83d1-4438-a062-053dabfc6bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:47.201966 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b7897-83d1-4438-a062-053dabfc6bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:47.212501 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b7897-83d1-4438-a062-053dabfc6bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:47.213976 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b7897-83d1-4438-a062-053dabfc6bd7 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:47.225137 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1390/2798] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:47 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:16:49.804775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4632aa-c167-412e-8001-9304fd72c759 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:49.868695 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4632aa-c167-412e-8001-9304fd72c759 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:49.873954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:49.874736 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:49.875103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:49.875430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] PATH_INFO: `/v3/users/0f25a5d57f154214a03200b4014fb6d6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:49.876624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f25a5d57f154214a03200b4014fb6d6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:49.878581 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:50.036000 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f25a5d57f154214a03200b4014fb6d6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:50.037205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:50.043722 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f25a5d57f154214a03200b4014fb6d6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:50.103334 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f25a5d57f154214a03200b4014fb6d6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:50.103960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f25a5d57f154214a03200b4014fb6d6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:50.104569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f25a5d57f154214a03200b4014fb6d6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:50.123325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1409/2799] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:16:49 2022] DELETE /identity/v3/users/0f25a5d57f154214a03200b4014fb6d6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:50.129139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02819-83c4-432b-b6a9-6712e633264c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:50.129676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02819-83c4-432b-b6a9-6712e633264c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:50.129791 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02819-83c4-432b-b6a9-6712e633264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:50.151805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d7c02819-83c4-432b-b6a9-6712e633264c None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:50.154085 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d7c02819-83c4-432b-b6a9-6712e633264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:50.212864 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1391/2800] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:50.222608 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:50.224008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:50.286688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea66dd-8a2e-4840-87e7-2ed891cd055d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:50.290280 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bc263-87c3-494d-be56-3a1f1a69fda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:50.290902 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bc263-87c3-494d-be56-3a1f1a69fda2 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:50.291177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bc263-87c3-494d-be56-3a1f1a69fda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:50.291447 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bc263-87c3-494d-be56-3a1f1a69fda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:50.301431 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bc263-87c3-494d-be56-3a1f1a69fda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:50.304370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bc263-87c3-494d-be56-3a1f1a69fda2 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:50.313800 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1410/2801] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:16:50.763310 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c02819-83c4-432b-b6a9-6712e633264c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:50.765081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d7c02819-83c4-432b-b6a9-6712e633264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:50.779591 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c02819-83c4-432b-b6a9-6712e633264c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:50.784347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:50.785003 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:50.785366 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:50.785646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] PATH_INFO: `/v3/projects/ea2c68f6e02a4fc983f8632480ac75b3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:50.786821 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2c68f6e02a4fc983f8632480ac75b3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:50.788750 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:50.893992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2c68f6e02a4fc983f8632480ac75b3', 'request_id': 'req-80d07d6e-f24f-44db-963d-fdc1afc31b09'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:50.900576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2c68f6e02a4fc983f8632480ac75b3', 'request_id': 'req-80d07d6e-f24f-44db-963d-fdc1afc31b09'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:50.983606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2c68f6e02a4fc983f8632480ac75b3', 'request_id': 'req-80d07d6e-f24f-44db-963d-fdc1afc31b09'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:50.995394 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] The token cache is being invalidate because project ea2c68f6e02a4fc983f8632480ac75b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:16:50.995691 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:50.996846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:50.998481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1392/2802] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:16:50 2022] DELETE /identity/v3/projects/ea2c68f6e02a4fc983f8632480ac75b3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:51.002906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bc263-87c3-494d-be56-3a1f1a69fda2 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:51.013149 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bc263-87c3-494d-be56-3a1f1a69fda2 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:51.072945 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:51.073528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:51.073808 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:51.074082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] PATH_INFO: `/v3/users/37505eb2572b48b182a1f8cc06ffcf74` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:51.075438 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=37505eb2572b48b182a1f8cc06ffcf74)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:51.077382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:51.260177 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37505eb2572b48b182a1f8cc06ffcf74'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:51.267562 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37505eb2572b48b182a1f8cc06ffcf74'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:51.348043 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37505eb2572b48b182a1f8cc06ffcf74'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:51.348579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37505eb2572b48b182a1f8cc06ffcf74'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:51.349317 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7d204655-aeca-44af-9f8b-8531e4209b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37505eb2572b48b182a1f8cc06ffcf74'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:51.355427 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:51.367757 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1411/2803] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:16:51 2022] DELETE /identity/v3/users/37505eb2572b48b182a1f8cc06ffcf74 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:51.773684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:51.775182 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:51.788816 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d07d6e-f24f-44db-963d-fdc1afc31b09 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:51.802301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:51.850112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:51.850829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:51.851109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:51.851382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] PATH_INFO: `/v3/projects/fe1a63d3806148aabf0566d7f63bdba0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:51.852585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1a63d3806148aabf0566d7f63bdba0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:51.854522 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:51.979024 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1a63d3806148aabf0566d7f63bdba0', 'request_id': 'req-35d91e08-5701-428d-bedf-a9b9660ec49b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:51.985725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1a63d3806148aabf0566d7f63bdba0', 'request_id': 'req-35d91e08-5701-428d-bedf-a9b9660ec49b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:52.047422 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1a63d3806148aabf0566d7f63bdba0', 'request_id': 'req-35d91e08-5701-428d-bedf-a9b9660ec49b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:52.058632 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] The token cache is being invalidate because project fe1a63d3806148aabf0566d7f63bdba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:16:52.059173 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:52.059847 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-35d91e08-5701-428d-bedf-a9b9660ec49b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:52.061392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1393/2804] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:16:51 2022] DELETE /identity/v3/projects/fe1a63d3806148aabf0566d7f63bdba0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:52.066349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a41a-f183-465f-bf6f-52b8d5144e6e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:52.066845 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a41a-f183-465f-bf6f-52b8d5144e6e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:52.066961 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a41a-f183-465f-bf6f-52b8d5144e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:52.087708 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6a00a41a-f183-465f-bf6f-52b8d5144e6e None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:52.088926 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6a00a41a-f183-465f-bf6f-52b8d5144e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:52.149594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1412/2805] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:16:52.158350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbce09d-baee-46ba-84dd-7c12ca60d2e8 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:52.158780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbce09d-baee-46ba-84dd-7c12ca60d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:52.159062 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbce09d-baee-46ba-84dd-7c12ca60d2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:52.179532 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ffbce09d-baee-46ba-84dd-7c12ca60d2e8 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:52.180734 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ffbce09d-baee-46ba-84dd-7c12ca60d2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:52.189954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1394/2806] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:52.194818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a41a-f183-465f-bf6f-52b8d5144e6e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:52.205409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a41a-f183-465f-bf6f-52b8d5144e6e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:52.210044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc36e4-d4e9-48e8-b603-72a5719e3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:52.210656 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc36e4-d4e9-48e8-b603-72a5719e3cbc admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:52.210938 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc36e4-d4e9-48e8-b603-72a5719e3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:52.211213 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc36e4-d4e9-48e8-b603-72a5719e3cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:52.211916 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc36e4-d4e9-48e8-b603-72a5719e3cbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:16:52.212219 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc36e4-d4e9-48e8-b603-72a5719e3cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:52.213859 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc36e4-d4e9-48e8-b603-72a5719e3cbc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:52.226413 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1413/2807] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:16:52.230951 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbce09d-baee-46ba-84dd-7c12ca60d2e8 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:52.240108 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbce09d-baee-46ba-84dd-7c12ca60d2e8 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:52.244746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d5179-cf1f-4842-8d31-82139b4c022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:52.245382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d5179-cf1f-4842-8d31-82139b4c022d admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:52.245662 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d5179-cf1f-4842-8d31-82139b4c022d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:52.245937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d5179-cf1f-4842-8d31-82139b4c022d admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:52.246753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d5179-cf1f-4842-8d31-82139b4c022d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:52.248632 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d5179-cf1f-4842-8d31-82139b4c022d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:52.334482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1395/2808] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:16:52 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:16:52.338922 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc36e4-d4e9-48e8-b603-72a5719e3cbc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:52.350302 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc36e4-d4e9-48e8-b603-72a5719e3cbc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:52.410400 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfed99-05e0-462c-981c-6956205654fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:52.411014 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfed99-05e0-462c-981c-6956205654fc admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:52.411293 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfed99-05e0-462c-981c-6956205654fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:52.411566 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfed99-05e0-462c-981c-6956205654fc admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:52.412373 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfed99-05e0-462c-981c-6956205654fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:52.414313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfed99-05e0-462c-981c-6956205654fc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:52.516969 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1414/2809] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:16:52 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:16:52.521270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d5179-cf1f-4842-8d31-82139b4c022d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:52.533564 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d5179-cf1f-4842-8d31-82139b4c022d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:52.538919 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d8fe6-f258-4b49-8171-ee39cd4588b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:52.539544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8fe6-f258-4b49-8171-ee39cd4588b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:52.539827 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8fe6-f258-4b49-8171-ee39cd4588b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:52.540105 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8fe6-f258-4b49-8171-ee39cd4588b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:52.540793 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d8fe6-f258-4b49-8171-ee39cd4588b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:52.542684 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d8fe6-f258-4b49-8171-ee39cd4588b1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:52.554332 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1396/2810] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:52.559487 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfed99-05e0-462c-981c-6956205654fc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:52.570376 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfed99-05e0-462c-981c-6956205654fc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:52.576274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb54f9-a24e-434a-8de3-8b5cec7c274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:52.576886 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb54f9-a24e-434a-8de3-8b5cec7c274d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:52.577332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb54f9-a24e-434a-8de3-8b5cec7c274d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:52.577697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb54f9-a24e-434a-8de3-8b5cec7c274d admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:52.578621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb54f9-a24e-434a-8de3-8b5cec7c274d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:52.580322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb54f9-a24e-434a-8de3-8b5cec7c274d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:52.591406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1415/2811] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:52.595681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d8fe6-f258-4b49-8171-ee39cd4588b1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:52.605577 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d8fe6-f258-4b49-8171-ee39cd4588b1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:52.610461 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a11151-f572-4194-a779-0d80ecfabb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:52.611131 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a11151-f572-4194-a779-0d80ecfabb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:52.611428 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a11151-f572-4194-a779-0d80ecfabb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:52.611700 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a11151-f572-4194-a779-0d80ecfabb64 admin admin] PATH_INFO: `/v3/projects/de4b043aaf664a8daccfe698f642d89c/users/b685781feeee468498941e5ebb72bf00/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:52.626884 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a11151-f572-4194-a779-0d80ecfabb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4b043aaf664a8daccfe698f642d89c, user_id=b685781feeee468498941e5ebb72bf00, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:52.629557 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a11151-f572-4194-a779-0d80ecfabb64 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:52.698275 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1397/2812] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:16:52 2022] PUT /identity/v3/projects/de4b043aaf664a8daccfe698f642d89c/users/b685781feeee468498941e5ebb72bf00/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:52.709530 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddcd18-d3f7-4cd5-b156-feac78d05706 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:52.709818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddcd18-d3f7-4cd5-b156-feac78d05706 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:52.710092 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddcd18-d3f7-4cd5-b156-feac78d05706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:52.737375 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-20ddcd18-d3f7-4cd5-b156-feac78d05706 None None] MFA Rules not processed for user `b685781feeee468498941e5ebb72bf00`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:52.738589 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-20ddcd18-d3f7-4cd5-b156-feac78d05706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:52.783630 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:52.807947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1416/2813] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:52.813712 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a11151-f572-4194-a779-0d80ecfabb64 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:52.860606 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:52.878249 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a11151-f572-4194-a779-0d80ecfabb64 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:52.883257 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f0667-8417-4cc7-8cdf-6b9e294d91bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:52.883933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0667-8417-4cc7-8cdf-6b9e294d91bd admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:52.884216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0667-8417-4cc7-8cdf-6b9e294d91bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:52.884492 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0667-8417-4cc7-8cdf-6b9e294d91bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:52.885204 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f0667-8417-4cc7-8cdf-6b9e294d91bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:52.887462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f0667-8417-4cc7-8cdf-6b9e294d91bd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:52.984843 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1398/2814] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:16:52 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:16:52.988993 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddcd18-d3f7-4cd5-b156-feac78d05706 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:53.000396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddcd18-d3f7-4cd5-b156-feac78d05706 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:53.055840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27adc2c-bc5a-4d32-9773-e525a09b40c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:53.056406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27adc2c-bc5a-4d32-9773-e525a09b40c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:53.056686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27adc2c-bc5a-4d32-9773-e525a09b40c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:53.056960 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27adc2c-bc5a-4d32-9773-e525a09b40c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:53.057671 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27adc2c-bc5a-4d32-9773-e525a09b40c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:53.060479 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27adc2c-bc5a-4d32-9773-e525a09b40c8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:53.160355 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1417/2815] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:16:52 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:16:53.164350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f0667-8417-4cc7-8cdf-6b9e294d91bd admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:53.175379 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f0667-8417-4cc7-8cdf-6b9e294d91bd admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:53.179924 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199bf4-9b8f-4501-aae2-1785095fffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:53.180517 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199bf4-9b8f-4501-aae2-1785095fffc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:53.180796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199bf4-9b8f-4501-aae2-1785095fffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:53.181068 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199bf4-9b8f-4501-aae2-1785095fffc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:53.181789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc199bf4-9b8f-4501-aae2-1785095fffc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:53.183360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc199bf4-9b8f-4501-aae2-1785095fffc9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:53.193796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1399/2816] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:53.197966 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27adc2c-bc5a-4d32-9773-e525a09b40c8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:53.207959 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27adc2c-bc5a-4d32-9773-e525a09b40c8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:53.212583 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3a3ce-09ff-4775-9d92-d37cd0882c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:53.213258 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3a3ce-09ff-4775-9d92-d37cd0882c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:53.213542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3a3ce-09ff-4775-9d92-d37cd0882c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:53.213822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3a3ce-09ff-4775-9d92-d37cd0882c0e admin admin] PATH_INFO: `/v3/projects/d12d66d825d24a2b9f834814b7265345/users/99b9b658f75d4f03933b390ee0bb39a3/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:53.228712 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3a3ce-09ff-4775-9d92-d37cd0882c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12d66d825d24a2b9f834814b7265345, user_id=99b9b658f75d4f03933b390ee0bb39a3, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:53.234444 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3a3ce-09ff-4775-9d92-d37cd0882c0e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:53.292007 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1418/2817] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:16:53 2022] PUT /identity/v3/projects/d12d66d825d24a2b9f834814b7265345/users/99b9b658f75d4f03933b390ee0bb39a3/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:53.297241 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199bf4-9b8f-4501-aae2-1785095fffc9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:53.307429 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199bf4-9b8f-4501-aae2-1785095fffc9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:53.362416 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cc4c5-ca79-43b4-b4a4-d81062e01a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:53.363029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc4c5-ca79-43b4-b4a4-d81062e01a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:53.363312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc4c5-ca79-43b4-b4a4-d81062e01a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:53.363613 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc4c5-ca79-43b4-b4a4-d81062e01a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:53.364314 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cc4c5-ca79-43b4-b4a4-d81062e01a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:53.365978 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cc4c5-ca79-43b4-b4a4-d81062e01a2d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:53.376693 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1400/2818] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:53.380870 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3a3ce-09ff-4775-9d92-d37cd0882c0e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:53.391883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3a3ce-09ff-4775-9d92-d37cd0882c0e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:53.396651 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aafc9b-cad1-4259-a6d0-e59456ea0de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:53.397361 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aafc9b-cad1-4259-a6d0-e59456ea0de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:53.397647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aafc9b-cad1-4259-a6d0-e59456ea0de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:53.397919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aafc9b-cad1-4259-a6d0-e59456ea0de9 admin admin] PATH_INFO: `/v3/projects/d12d66d825d24a2b9f834814b7265345/users/99b9b658f75d4f03933b390ee0bb39a3/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:53.400086 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aafc9b-cad1-4259-a6d0-e59456ea0de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12d66d825d24a2b9f834814b7265345, user_id=99b9b658f75d4f03933b390ee0bb39a3, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:53.403325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aafc9b-cad1-4259-a6d0-e59456ea0de9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:53.414137 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1419/2819] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:16:53 2022] PUT /identity/v3/projects/d12d66d825d24a2b9f834814b7265345/users/99b9b658f75d4f03933b390ee0bb39a3/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:53.425928 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a734f5-cf46-4673-a6f3-8ac75bf54888 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:53.426228 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a734f5-cf46-4673-a6f3-8ac75bf54888 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:53.426507 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a734f5-cf46-4673-a6f3-8ac75bf54888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:53.457479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-08a734f5-cf46-4673-a6f3-8ac75bf54888 None None] MFA Rules not processed for user `99b9b658f75d4f03933b390ee0bb39a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:53.458708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-08a734f5-cf46-4673-a6f3-8ac75bf54888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:53.537592 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1401/2820] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:53 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:53.549925 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aafc9b-cad1-4259-a6d0-e59456ea0de9 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:53.551601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e6aafc9b-cad1-4259-a6d0-e59456ea0de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:53.612319 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aafc9b-cad1-4259-a6d0-e59456ea0de9 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:53.615986 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43437e53-0fc9-4e88-9836-579cf2b1a7d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:53.616601 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43437e53-0fc9-4e88-9836-579cf2b1a7d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:53.616883 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43437e53-0fc9-4e88-9836-579cf2b1a7d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:53.617191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43437e53-0fc9-4e88-9836-579cf2b1a7d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:53.626191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43437e53-0fc9-4e88-9836-579cf2b1a7d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:53.627624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43437e53-0fc9-4e88-9836-579cf2b1a7d6 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:53.638389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1420/2821] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:53 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:16:53.753901 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a734f5-cf46-4673-a6f3-8ac75bf54888 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:53.755296 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-08a734f5-cf46-4673-a6f3-8ac75bf54888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:53.768333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a734f5-cf46-4673-a6f3-8ac75bf54888 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:53.771980 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85083d52-76a7-4484-a1a9-3dde2a4bdc3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:53.772585 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85083d52-76a7-4484-a1a9-3dde2a4bdc3f service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:53.772874 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85083d52-76a7-4484-a1a9-3dde2a4bdc3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:53.773183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85083d52-76a7-4484-a1a9-3dde2a4bdc3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:53.807236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:53.830942 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85083d52-76a7-4484-a1a9-3dde2a4bdc3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:53.832392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85083d52-76a7-4484-a1a9-3dde2a4bdc3f service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:53.842696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1402/2822] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:16:58.926569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43437e53-0fc9-4e88-9836-579cf2b1a7d6 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:58.928111 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-43437e53-0fc9-4e88-9836-579cf2b1a7d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:58.985373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85083d52-76a7-4484-a1a9-3dde2a4bdc3f service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:58.989464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:59.031162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43437e53-0fc9-4e88-9836-579cf2b1a7d6 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:59.039665 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c196-07d9-490c-9429-18b03d4b9294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:59.040647 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c196-07d9-490c-9429-18b03d4b9294 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:59.041180 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c196-07d9-490c-9429-18b03d4b9294 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:59.041627 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c196-07d9-490c-9429-18b03d4b9294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:59.044180 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1081c196-07d9-490c-9429-18b03d4b9294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:59.059299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081c196-07d9-490c-9429-18b03d4b9294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:59.062598 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081c196-07d9-490c-9429-18b03d4b9294 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:59.074514 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85083d52-76a7-4484-a1a9-3dde2a4bdc3f service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:59.081324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:59.082083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:59.082368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:59.082647 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] PATH_INFO: `/v3/users/b685781feeee468498941e5ebb72bf00` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:59.087191 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b685781feeee468498941e5ebb72bf00)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:59.090348 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1421/2823] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:16:59.090986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:59.283511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b685781feeee468498941e5ebb72bf00'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:59.284899 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b685781feeee468498941e5ebb72bf00'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:59.382258 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b685781feeee468498941e5ebb72bf00'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:59.396896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b685781feeee468498941e5ebb72bf00'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:59.405327 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b685781feeee468498941e5ebb72bf00'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:59.412094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1403/2824] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:16:58 2022] DELETE /identity/v3/users/b685781feeee468498941e5ebb72bf00 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:16:59.416783 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b60c1b-b1ae-4f0d-a8d0-61ba86b45df7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:59.420822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b60c1b-b1ae-4f0d-a8d0-61ba86b45df7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:59.420822 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b60c1b-b1ae-4f0d-a8d0-61ba86b45df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:59.444843 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-59b60c1b-b1ae-4f0d-a8d0-61ba86b45df7 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:59.446416 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-59b60c1b-b1ae-4f0d-a8d0-61ba86b45df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:59.513354 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1422/2825] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:59.524305 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:59.525777 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:59.588339 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faf78f-b179-4ef0-b715-5ff9faf82fdb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:59.593111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d3ed5-7e3c-4541-863b-64429cd797b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:59.593839 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d3ed5-7e3c-4541-863b-64429cd797b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:59.594251 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d3ed5-7e3c-4541-863b-64429cd797b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:59.594516 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d3ed5-7e3c-4541-863b-64429cd797b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:59.605005 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d3ed5-7e3c-4541-863b-64429cd797b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:59.606502 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d3ed5-7e3c-4541-863b-64429cd797b9 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:59.612462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:59.619607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1404/2826] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:17:00.097904 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b60c1b-b1ae-4f0d-a8d0-61ba86b45df7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:00.099372 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-59b60c1b-b1ae-4f0d-a8d0-61ba86b45df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:00.114797 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b60c1b-b1ae-4f0d-a8d0-61ba86b45df7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:00.120389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:00.121272 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:00.121579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:00.126668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] PATH_INFO: `/v3/projects/de4b043aaf664a8daccfe698f642d89c` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:00.126668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4b043aaf664a8daccfe698f642d89c)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:00.126668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:00.220476 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4b043aaf664a8daccfe698f642d89c', 'request_id': 'req-538ee2e2-77f0-4169-9e6e-97988fcf0daf'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:00.226864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4b043aaf664a8daccfe698f642d89c', 'request_id': 'req-538ee2e2-77f0-4169-9e6e-97988fcf0daf'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:00.232257 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4b043aaf664a8daccfe698f642d89c', 'request_id': 'req-538ee2e2-77f0-4169-9e6e-97988fcf0daf'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:00.320625 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] The token cache is being invalidate because project de4b043aaf664a8daccfe698f642d89c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:17:00.320915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:00.321564 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-538ee2e2-77f0-4169-9e6e-97988fcf0daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:00.323087 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1423/2827] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:17:00 2022] DELETE /identity/v3/projects/de4b043aaf664a8daccfe698f642d89c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:00.327246 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d3ed5-7e3c-4541-863b-64429cd797b9 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:00.337423 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d3ed5-7e3c-4541-863b-64429cd797b9 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:00.395909 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:00.396547 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:00.396856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:00.397352 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] PATH_INFO: `/v3/users/99b9b658f75d4f03933b390ee0bb39a3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:00.398563 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b9b658f75d4f03933b390ee0bb39a3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:00.400479 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:00.597088 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b9b658f75d4f03933b390ee0bb39a3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:00.597784 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b9b658f75d4f03933b390ee0bb39a3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:00.692489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b9b658f75d4f03933b390ee0bb39a3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:00.705836 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b9b658f75d4f03933b390ee0bb39a3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:00.712685 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b9b658f75d4f03933b390ee0bb39a3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:00.718890 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1405/2828] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:17:00 2022] DELETE /identity/v3/users/99b9b658f75d4f03933b390ee0bb39a3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:00.956919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c7c57-0485-47e1-a968-f8d36750b91e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:00.957322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c7c57-0485-47e1-a968-f8d36750b91e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:00.957610 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c7c57-0485-47e1-a968-f8d36750b91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:00.979134 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-214c7c57-0485-47e1-a968-f8d36750b91e None None] MFA Rules not processed for user `c862a035745641b5a8dde92a3d570b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:00.980360 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-214c7c57-0485-47e1-a968-f8d36750b91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:01.025819 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:01.040552 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1424/2829] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:01.191040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:01.192540 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:01.269360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b01262-512d-4125-8b91-f93309be263b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:01.274237 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:01.274877 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:01.275156 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:01.275431 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] PATH_INFO: `/v3/projects/d12d66d825d24a2b9f834814b7265345` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:01.276582 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12d66d825d24a2b9f834814b7265345)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:01.278508 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:01.306079 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:01.364731 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c7c57-0485-47e1-a968-f8d36750b91e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:01.366248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-214c7c57-0485-47e1-a968-f8d36750b91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:01.391206 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12d66d825d24a2b9f834814b7265345', 'request_id': 'req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:01.397657 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12d66d825d24a2b9f834814b7265345', 'request_id': 'req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:01.427383 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c7c57-0485-47e1-a968-f8d36750b91e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:01.476256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6549f-bb9c-4eb0-806c-edf86933280c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:01.476793 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6549f-bb9c-4eb0-806c-edf86933280c service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:01.477070 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6549f-bb9c-4eb0-806c-edf86933280c service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:01.477371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6549f-bb9c-4eb0-806c-edf86933280c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:01.479115 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7dd6549f-bb9c-4eb0-806c-edf86933280c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:01.484878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12d66d825d24a2b9f834814b7265345', 'request_id': 'req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:01.489653 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6549f-bb9c-4eb0-806c-edf86933280c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:01.491165 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6549f-bb9c-4eb0-806c-edf86933280c service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:01.495891 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] The token cache is being invalidate because project d12d66d825d24a2b9f834814b7265345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:17:01.496293 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:01.499753 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-445dd1b3-a1f1-41e9-b7ac-34622d6bc44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:01.499992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1406/2830] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:17:01 2022] DELETE /identity/v3/projects/d12d66d825d24a2b9f834814b7265345 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:01.500718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1425/2831] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:17:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:17:01.504851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ceac1-270d-4966-bbdd-e2b51415f27a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:01.505165 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ceac1-270d-4966-bbdd-e2b51415f27a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:01.505450 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ceac1-270d-4966-bbdd-e2b51415f27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:01.531476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-541ceac1-270d-4966-bbdd-e2b51415f27a None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:01.532780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-541ceac1-270d-4966-bbdd-e2b51415f27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:01.593925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1407/2832] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:01.601996 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fcf76-3b86-414a-bbe8-e4b000859bda None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:01.602278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fcf76-3b86-414a-bbe8-e4b000859bda None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:01.602548 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fcf76-3b86-414a-bbe8-e4b000859bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:01.622872 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c20fcf76-3b86-414a-bbe8-e4b000859bda None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:01.624771 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c20fcf76-3b86-414a-bbe8-e4b000859bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:01.632809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1426/2833] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:01.637080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ceac1-270d-4966-bbdd-e2b51415f27a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:01.648004 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ceac1-270d-4966-bbdd-e2b51415f27a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:01.652699 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf72313-c549-49f6-8129-a6ab522ed361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:01.653351 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf72313-c549-49f6-8129-a6ab522ed361 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:01.653634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf72313-c549-49f6-8129-a6ab522ed361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:01.653910 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf72313-c549-49f6-8129-a6ab522ed361 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:01.654817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf72313-c549-49f6-8129-a6ab522ed361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:17:01.655224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf72313-c549-49f6-8129-a6ab522ed361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:01.656856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf72313-c549-49f6-8129-a6ab522ed361 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:01.669147 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1408/2834] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:17:01.673439 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fcf76-3b86-414a-bbe8-e4b000859bda None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:01.682956 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fcf76-3b86-414a-bbe8-e4b000859bda None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:01.688459 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a75cb-2a22-4eb5-b599-59078dc75bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:01.689085 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a75cb-2a22-4eb5-b599-59078dc75bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:01.689398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a75cb-2a22-4eb5-b599-59078dc75bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:01.689676 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a75cb-2a22-4eb5-b599-59078dc75bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:01.690345 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a75cb-2a22-4eb5-b599-59078dc75bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:01.692343 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a75cb-2a22-4eb5-b599-59078dc75bd2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:01.778286 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1427/2835] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:17:01 2022] POST /identity/v3/projects => generated 407 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:17:01.782707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf72313-c549-49f6-8129-a6ab522ed361 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:01.793083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf72313-c549-49f6-8129-a6ab522ed361 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:01.855289 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f934a4-f888-4a4c-8069-ab117520bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:01.855988 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f934a4-f888-4a4c-8069-ab117520bd77 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:01.856250 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f934a4-f888-4a4c-8069-ab117520bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:01.856529 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f934a4-f888-4a4c-8069-ab117520bd77 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:01.857229 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f934a4-f888-4a4c-8069-ab117520bd77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:01.859937 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f934a4-f888-4a4c-8069-ab117520bd77 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:01.967377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1409/2836] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:17:01 2022] POST /identity/v3/users => generated 304 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:17:01.971166 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a75cb-2a22-4eb5-b599-59078dc75bd2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:01.981659 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a75cb-2a22-4eb5-b599-59078dc75bd2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:01.987170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcfbf6-a1dc-41b4-9b1d-485ca99dec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:01.987862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcfbf6-a1dc-41b4-9b1d-485ca99dec42 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:01.988088 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcfbf6-a1dc-41b4-9b1d-485ca99dec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:01.988369 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcfbf6-a1dc-41b4-9b1d-485ca99dec42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:01.989069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcfbf6-a1dc-41b4-9b1d-485ca99dec42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:01.990718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcfbf6-a1dc-41b4-9b1d-485ca99dec42 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:02.002571 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1428/2837] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:17:02.006745 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f934a4-f888-4a4c-8069-ab117520bd77 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:02.017469 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f934a4-f888-4a4c-8069-ab117520bd77 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:02.022200 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20880392-8983-4b81-9a0a-d2ceb30074a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:02.022817 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20880392-8983-4b81-9a0a-d2ceb30074a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.023099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20880392-8983-4b81-9a0a-d2ceb30074a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.023376 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20880392-8983-4b81-9a0a-d2ceb30074a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:02.024080 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20880392-8983-4b81-9a0a-d2ceb30074a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:02.025725 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20880392-8983-4b81-9a0a-d2ceb30074a0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:02.036634 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1410/2838] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:17:02.040840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcfbf6-a1dc-41b4-9b1d-485ca99dec42 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:02.051482 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcfbf6-a1dc-41b4-9b1d-485ca99dec42 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:02.056136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd06eb-1df4-4f37-8090-3814c15e3968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:02.056805 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd06eb-1df4-4f37-8090-3814c15e3968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.057089 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd06eb-1df4-4f37-8090-3814c15e3968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.057396 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd06eb-1df4-4f37-8090-3814c15e3968 admin admin] PATH_INFO: `/v3/projects/a440a7ea7e104003a44c1765c1cdcef7/users/8f5fec125b134f5d988ae6d5892488ba/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:02.073242 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd06eb-1df4-4f37-8090-3814c15e3968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a440a7ea7e104003a44c1765c1cdcef7, user_id=8f5fec125b134f5d988ae6d5892488ba, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:02.075929 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd06eb-1df4-4f37-8090-3814c15e3968 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:02.161639 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1429/2839] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:17:02 2022] PUT /identity/v3/projects/a440a7ea7e104003a44c1765c1cdcef7/users/8f5fec125b134f5d988ae6d5892488ba/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:17:02.172584 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416aab6-519e-4410-9582-429a1f7f05a0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.172870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416aab6-519e-4410-9582-429a1f7f05a0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.173178 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416aab6-519e-4410-9582-429a1f7f05a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:02.197605 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:02.200763 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2416aab6-519e-4410-9582-429a1f7f05a0 None None] MFA Rules not processed for user `8f5fec125b134f5d988ae6d5892488ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:02.202110 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2416aab6-519e-4410-9582-429a1f7f05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:02.280971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1411/2840] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:02.281919 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd06eb-1df4-4f37-8090-3814c15e3968 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:02.313986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416aab6-519e-4410-9582-429a1f7f05a0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:02.316140 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2416aab6-519e-4410-9582-429a1f7f05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:02.338234 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:02.354076 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd06eb-1df4-4f37-8090-3814c15e3968 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:02.360297 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3681-c95f-43a1-8e20-a7e8689944b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:02.360943 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3681-c95f-43a1-8e20-a7e8689944b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.361263 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3681-c95f-43a1-8e20-a7e8689944b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.361544 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3681-c95f-43a1-8e20-a7e8689944b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:02.362787 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc3681-c95f-43a1-8e20-a7e8689944b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:02.364473 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc3681-c95f-43a1-8e20-a7e8689944b9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:02.402372 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416aab6-519e-4410-9582-429a1f7f05a0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:02.408273 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0868da-6708-44ce-8700-bf8b6313592d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:02.408900 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0868da-6708-44ce-8700-bf8b6313592d service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.409217 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0868da-6708-44ce-8700-bf8b6313592d service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.409496 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0868da-6708-44ce-8700-bf8b6313592d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:02.411306 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9c0868da-6708-44ce-8700-bf8b6313592d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:02.423328 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0868da-6708-44ce-8700-bf8b6313592d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:02.424917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0868da-6708-44ce-8700-bf8b6313592d service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:02.434984 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1412/2841] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:17:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:17:02.482162 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1430/2842] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:17:02 2022] POST /identity/v3/projects => generated 407 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:17:02.486491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0868da-6708-44ce-8700-bf8b6313592d service placement] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:02.497030 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0868da-6708-44ce-8700-bf8b6313592d service placement] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:02.556832 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4d8cc-19b8-41be-b593-7d778d889a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:02.557489 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4d8cc-19b8-41be-b593-7d778d889a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.558056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4d8cc-19b8-41be-b593-7d778d889a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.558340 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4d8cc-19b8-41be-b593-7d778d889a35 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:02.559081 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4d8cc-19b8-41be-b593-7d778d889a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:02.562034 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4d8cc-19b8-41be-b593-7d778d889a35 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:02.669726 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1413/2843] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:17:02 2022] POST /identity/v3/users => generated 310 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:17:02.674440 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3681-c95f-43a1-8e20-a7e8689944b9 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:02.685183 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3681-c95f-43a1-8e20-a7e8689944b9 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:02.690315 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01ace2-415a-4317-9f57-0810a45c54eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:02.691008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01ace2-415a-4317-9f57-0810a45c54eb admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.691284 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01ace2-415a-4317-9f57-0810a45c54eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.691559 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01ace2-415a-4317-9f57-0810a45c54eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:02.692253 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01ace2-415a-4317-9f57-0810a45c54eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:02.694214 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01ace2-415a-4317-9f57-0810a45c54eb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:02.704645 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1431/2844] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:17:02.709541 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4d8cc-19b8-41be-b593-7d778d889a35 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:02.719852 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4d8cc-19b8-41be-b593-7d778d889a35 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:02.724526 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3241b4-2908-4f26-b2d2-688d232ca063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:02.725377 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3241b4-2908-4f26-b2d2-688d232ca063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.725660 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3241b4-2908-4f26-b2d2-688d232ca063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.725938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3241b4-2908-4f26-b2d2-688d232ca063 admin admin] PATH_INFO: `/v3/projects/a4d1fc47d0e64c8ea466551552cacfbc/users/b7e4415df7c54e69b6656233b01490c8/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:02.741553 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3241b4-2908-4f26-b2d2-688d232ca063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d1fc47d0e64c8ea466551552cacfbc, user_id=b7e4415df7c54e69b6656233b01490c8, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:02.744287 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3241b4-2908-4f26-b2d2-688d232ca063 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:02.818856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:02.824960 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1414/2845] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:17:02 2022] PUT /identity/v3/projects/a4d1fc47d0e64c8ea466551552cacfbc/users/b7e4415df7c54e69b6656233b01490c8/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:17:02.829500 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01ace2-415a-4317-9f57-0810a45c54eb admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:02.840609 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01ace2-415a-4317-9f57-0810a45c54eb admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:02.909389 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cbd7a-b9ae-478e-af32-fcae0e50bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:02.910012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cbd7a-b9ae-478e-af32-fcae0e50bec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.910386 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cbd7a-b9ae-478e-af32-fcae0e50bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.910767 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cbd7a-b9ae-478e-af32-fcae0e50bec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:02.911464 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cbd7a-b9ae-478e-af32-fcae0e50bec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:02.913873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cbd7a-b9ae-478e-af32-fcae0e50bec6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:02.925814 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1432/2846] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:17:02.929954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3241b4-2908-4f26-b2d2-688d232ca063 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:02.940386 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3241b4-2908-4f26-b2d2-688d232ca063 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:02.945029 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea07e3-d165-4121-a468-4f471efa757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:02.945760 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea07e3-d165-4121-a468-4f471efa757a admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.946040 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea07e3-d165-4121-a468-4f471efa757a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.946317 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea07e3-d165-4121-a468-4f471efa757a admin admin] PATH_INFO: `/v3/projects/a4d1fc47d0e64c8ea466551552cacfbc/users/b7e4415df7c54e69b6656233b01490c8/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:02.948312 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea07e3-d165-4121-a468-4f471efa757a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d1fc47d0e64c8ea466551552cacfbc, user_id=b7e4415df7c54e69b6656233b01490c8, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:02.950996 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea07e3-d165-4121-a468-4f471efa757a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:02.974389 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1415/2847] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:17:02 2022] PUT /identity/v3/projects/a4d1fc47d0e64c8ea466551552cacfbc/users/b7e4415df7c54e69b6656233b01490c8/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:02.975811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70c05a-5341-4475-a239-1a0e21ea1c59 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:02.976281 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70c05a-5341-4475-a239-1a0e21ea1c59 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:02.976569 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70c05a-5341-4475-a239-1a0e21ea1c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:03.006934 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6b70c05a-5341-4475-a239-1a0e21ea1c59 None None] MFA Rules not processed for user `b7e4415df7c54e69b6656233b01490c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:03.008170 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6b70c05a-5341-4475-a239-1a0e21ea1c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:03.078827 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1433/2848] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:17:03.089552 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea07e3-d165-4121-a468-4f471efa757a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:03.091316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b5ea07e3-d165-4121-a468-4f471efa757a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:03.150607 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea07e3-d165-4121-a468-4f471efa757a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:03.154324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a9376-aba2-450a-b7d8-96da8f889c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:03.155177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9376-aba2-450a-b7d8-96da8f889c40 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:03.155463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9376-aba2-450a-b7d8-96da8f889c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:03.155766 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9376-aba2-450a-b7d8-96da8f889c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:03.164971 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a9376-aba2-450a-b7d8-96da8f889c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:03.166442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a9376-aba2-450a-b7d8-96da8f889c40 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:03.176203 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1416/2849] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:17:03 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:17:03.575537 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70c05a-5341-4475-a239-1a0e21ea1c59 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:03.586866 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70c05a-5341-4475-a239-1a0e21ea1c59 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:03.590563 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a4d08-1828-4848-8751-56760b766097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:03.591194 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a4d08-1828-4848-8751-56760b766097 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:03.591475 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a4d08-1828-4848-8751-56760b766097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:03.591876 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a4d08-1828-4848-8751-56760b766097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:03.633894 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:03.650858 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a4d08-1828-4848-8751-56760b766097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:03.652239 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a4d08-1828-4848-8751-56760b766097 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:03.661528 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1434/2850] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:17:03 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:17:13.171892 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:13.557933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a9376-aba2-450a-b7d8-96da8f889c40 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:13.621581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a9376-aba2-450a-b7d8-96da8f889c40 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:13.626934 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:13.627636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:13.627915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:13.628190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] PATH_INFO: `/v3/users/8f5fec125b134f5d988ae6d5892488ba` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:13.629404 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5fec125b134f5d988ae6d5892488ba)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:13.631321 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:13.788915 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=9 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:13.831463 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5fec125b134f5d988ae6d5892488ba'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:13.832187 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5fec125b134f5d988ae6d5892488ba'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:13.937869 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5fec125b134f5d988ae6d5892488ba'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:13.951646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5fec125b134f5d988ae6d5892488ba'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:13.958848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5fec125b134f5d988ae6d5892488ba'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:13.965093 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1417/2851] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:17:13 2022] DELETE /identity/v3/users/8f5fec125b134f5d988ae6d5892488ba => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:13.969998 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03fa88-aaf2-490d-8b31-7ee872abb7c4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:13.970278 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03fa88-aaf2-490d-8b31-7ee872abb7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:13.970550 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03fa88-aaf2-490d-8b31-7ee872abb7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:13.989972 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0f03fa88-aaf2-490d-8b31-7ee872abb7c4 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:13.991191 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0f03fa88-aaf2-490d-8b31-7ee872abb7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:14.051116 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1435/2852] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:14.060983 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:14.062401 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:14.124858 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b003e2a-81ab-4e97-934c-9db26eff11c8 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:14.129391 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c90eee-2fcb-42b3-9dd0-63d24df15a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:14.130112 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c90eee-2fcb-42b3-9dd0-63d24df15a12 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:14.130484 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c90eee-2fcb-42b3-9dd0-63d24df15a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:14.130845 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c90eee-2fcb-42b3-9dd0-63d24df15a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:14.143061 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c90eee-2fcb-42b3-9dd0-63d24df15a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:14.144525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c90eee-2fcb-42b3-9dd0-63d24df15a12 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:14.154316 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1418/2853] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:17:14.601409 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03fa88-aaf2-490d-8b31-7ee872abb7c4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:14.603040 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0f03fa88-aaf2-490d-8b31-7ee872abb7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:14.617497 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03fa88-aaf2-490d-8b31-7ee872abb7c4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:14.623813 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:14.624664 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:14.624941 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:14.625248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] PATH_INFO: `/v3/projects/a440a7ea7e104003a44c1765c1cdcef7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:14.626596 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a440a7ea7e104003a44c1765c1cdcef7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:14.629519 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:14.742197 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a440a7ea7e104003a44c1765c1cdcef7', 'request_id': 'req-79efcf0a-5154-420c-b583-1378fbc5c72e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:14.748936 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a440a7ea7e104003a44c1765c1cdcef7', 'request_id': 'req-79efcf0a-5154-420c-b583-1378fbc5c72e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:14.754644 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a440a7ea7e104003a44c1765c1cdcef7', 'request_id': 'req-79efcf0a-5154-420c-b583-1378fbc5c72e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:14.875849 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] The token cache is being invalidate because project a440a7ea7e104003a44c1765c1cdcef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:17:14.876387 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:14.876755 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:14.878304 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1436/2854] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:17:14 2022] DELETE /identity/v3/projects/a440a7ea7e104003a44c1765c1cdcef7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:14.882848 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c90eee-2fcb-42b3-9dd0-63d24df15a12 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:14.893436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c90eee-2fcb-42b3-9dd0-63d24df15a12 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:14.911932 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:14.949728 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:14.950392 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:14.950681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:14.951109 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] PATH_INFO: `/v3/users/b7e4415df7c54e69b6656233b01490c8` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:14.952323 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e4415df7c54e69b6656233b01490c8)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:14.954278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:15.311084 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e4415df7c54e69b6656233b01490c8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:15.311710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e4415df7c54e69b6656233b01490c8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:15.399933 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e4415df7c54e69b6656233b01490c8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:15.414270 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e4415df7c54e69b6656233b01490c8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:15.421473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6ee6838-a351-4f1f-ac15-d87d942fd3cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e4415df7c54e69b6656233b01490c8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:15.427319 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1419/2855] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:17:14 2022] DELETE /identity/v3/users/b7e4415df7c54e69b6656233b01490c8 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:15.923010 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:15.924452 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:15.938560 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efcf0a-5154-420c-b583-1378fbc5c72e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:16.002947 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:16.003590 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:16.003869 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:16.004140 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] PATH_INFO: `/v3/projects/a4d1fc47d0e64c8ea466551552cacfbc` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:16.005325 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d1fc47d0e64c8ea466551552cacfbc)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:16.007222 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:16.099005 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:16.116155 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d1fc47d0e64c8ea466551552cacfbc', 'request_id': 'req-e955fcb3-0f34-4526-97d6-250f0a15c383'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:16.122349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d1fc47d0e64c8ea466551552cacfbc', 'request_id': 'req-e955fcb3-0f34-4526-97d6-250f0a15c383'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:16.127977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d1fc47d0e64c8ea466551552cacfbc', 'request_id': 'req-e955fcb3-0f34-4526-97d6-250f0a15c383'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:16.209675 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] The token cache is being invalidate because project a4d1fc47d0e64c8ea466551552cacfbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:17:16.209965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:16.210586 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e955fcb3-0f34-4526-97d6-250f0a15c383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:17:16.212107 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1437/2856] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:17:15 2022] DELETE /identity/v3/projects/a4d1fc47d0e64c8ea466551552cacfbc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:16.225835 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee732-d631-430a-8f04-b30e97f1c937 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:16.226368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee732-d631-430a-8f04-b30e97f1c937 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:16.226368 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee732-d631-430a-8f04-b30e97f1c937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:16.246424 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-047ee732-d631-430a-8f04-b30e97f1c937 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:16.247746 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-047ee732-d631-430a-8f04-b30e97f1c937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:16.306686 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1420/2857] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:16.314917 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e775512-9f75-4724-b95b-0d99e86ec148 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:16.315206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e775512-9f75-4724-b95b-0d99e86ec148 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:16.315483 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e775512-9f75-4724-b95b-0d99e86ec148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:16.335853 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7e775512-9f75-4724-b95b-0d99e86ec148 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:16.337074 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7e775512-9f75-4724-b95b-0d99e86ec148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:16.345867 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1438/2858] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:16.350078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ee732-d631-430a-8f04-b30e97f1c937 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:16.359925 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ee732-d631-430a-8f04-b30e97f1c937 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:16.364500 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae4efb-3584-464c-bedf-f1aae6aa551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:16.365106 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4efb-3584-464c-bedf-f1aae6aa551b admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:16.365430 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4efb-3584-464c-bedf-f1aae6aa551b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:16.365708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4efb-3584-464c-bedf-f1aae6aa551b admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:16.366451 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae4efb-3584-464c-bedf-f1aae6aa551b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:17:16.366698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae4efb-3584-464c-bedf-f1aae6aa551b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:16.368289 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae4efb-3584-464c-bedf-f1aae6aa551b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:16.380243 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1421/2859] 10.222.0.55 () {58 vars in 1153 bytes} [Mon Jul 25 23:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:17:16.384668 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e775512-9f75-4724-b95b-0d99e86ec148 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:16.394680 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e775512-9f75-4724-b95b-0d99e86ec148 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:16.399363 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7198afd-b965-444b-868e-f72c9f4d55fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:16.399965 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198afd-b965-444b-868e-f72c9f4d55fd admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:16.400245 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198afd-b965-444b-868e-f72c9f4d55fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:16.400513 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198afd-b965-444b-868e-f72c9f4d55fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:16.401206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7198afd-b965-444b-868e-f72c9f4d55fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:16.403106 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7198afd-b965-444b-868e-f72c9f4d55fd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:16.539143 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1439/2860] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:17:16 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:17:16.543318 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae4efb-3584-464c-bedf-f1aae6aa551b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:16.553567 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae4efb-3584-464c-bedf-f1aae6aa551b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:16.580247 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:16.608940 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06138974-85f0-4d1c-8c46-210372ad04d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:16.609581 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138974-85f0-4d1c-8c46-210372ad04d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:16.609861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138974-85f0-4d1c-8c46-210372ad04d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:16.610132 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138974-85f0-4d1c-8c46-210372ad04d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:16.610790 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06138974-85f0-4d1c-8c46-210372ad04d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:16.613008 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06138974-85f0-4d1c-8c46-210372ad04d4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:16.707578 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1422/2861] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:17:16 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:17:16.709063 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7198afd-b965-444b-868e-f72c9f4d55fd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:16.719913 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7198afd-b965-444b-868e-f72c9f4d55fd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:16.724806 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8cd1-16f8-493b-aec1-594a0eb029b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:16.725457 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8cd1-16f8-493b-aec1-594a0eb029b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:16.725742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8cd1-16f8-493b-aec1-594a0eb029b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:16.726044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8cd1-16f8-493b-aec1-594a0eb029b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:16.726742 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa8cd1-16f8-493b-aec1-594a0eb029b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:16.728313 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa8cd1-16f8-493b-aec1-594a0eb029b1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:16.739100 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1440/2862] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:17:16.746235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06138974-85f0-4d1c-8c46-210372ad04d4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:16.758091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06138974-85f0-4d1c-8c46-210372ad04d4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:16.764861 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e4f01-9842-45cd-860a-509d485e161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:16.765738 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e4f01-9842-45cd-860a-509d485e161a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:16.766197 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e4f01-9842-45cd-860a-509d485e161a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:16.766632 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e4f01-9842-45cd-860a-509d485e161a admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:16.767490 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e4f01-9842-45cd-860a-509d485e161a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:16.769288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e4f01-9842-45cd-860a-509d485e161a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:16.780822 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1423/2863] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:17:16.785256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8cd1-16f8-493b-aec1-594a0eb029b1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:16.798821 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8cd1-16f8-493b-aec1-594a0eb029b1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:16.803592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06ac87-3b57-4fa4-92ca-01dbde2d004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:16.804274 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06ac87-3b57-4fa4-92ca-01dbde2d004c admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:16.804557 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06ac87-3b57-4fa4-92ca-01dbde2d004c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:16.804840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06ac87-3b57-4fa4-92ca-01dbde2d004c admin admin] PATH_INFO: `/v3/projects/249b4da896194c73b9ef659a254dea52/users/e86e64a691c048e091ae6a23b5edf048/roles/8458ab7384a043d2a03698163d3892fd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:16.822901 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06ac87-3b57-4fa4-92ca-01dbde2d004c admin admin] RBAC: Authorizing `identity:create_grant(project_id=249b4da896194c73b9ef659a254dea52, user_id=e86e64a691c048e091ae6a23b5edf048, role_id=8458ab7384a043d2a03698163d3892fd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:16.825674 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06ac87-3b57-4fa4-92ca-01dbde2d004c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:16.891257 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1441/2864] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:17:16 2022] PUT /identity/v3/projects/249b4da896194c73b9ef659a254dea52/users/e86e64a691c048e091ae6a23b5edf048/roles/8458ab7384a043d2a03698163d3892fd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:16.896455 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf9f70-22f7-4690-994d-660d21082bf3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:16.896780 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf9f70-22f7-4690-994d-660d21082bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:16.897063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf9f70-22f7-4690-994d-660d21082bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:16.916716 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8bdf9f70-22f7-4690-994d-660d21082bf3 None None] MFA Rules not processed for user `eb5b24c5d3054270abb8dbb4d3ba574a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:16.918064 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8bdf9f70-22f7-4690-994d-660d21082bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:16.981652 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1424/2865] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:16.992020 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06ac87-3b57-4fa4-92ca-01dbde2d004c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:16.993906 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ea06ac87-3b57-4fa4-92ca-01dbde2d004c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:17.058012 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06ac87-3b57-4fa4-92ca-01dbde2d004c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:17.062056 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faa988-8b9a-4cca-b99d-c24138ee6b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:17.062685 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faa988-8b9a-4cca-b99d-c24138ee6b6c service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:17.062995 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faa988-8b9a-4cca-b99d-c24138ee6b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:17.063277 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faa988-8b9a-4cca-b99d-c24138ee6b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:17.072977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3faa988-8b9a-4cca-b99d-c24138ee6b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:17.074462 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3faa988-8b9a-4cca-b99d-c24138ee6b6c service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:17.085398 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1442/2866] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:17:22.547796 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611652cb-11c1-4d60-bc14-993b036230ce None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:22.548696 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611652cb-11c1-4d60-bc14-993b036230ce None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:22.549179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611652cb-11c1-4d60-bc14-993b036230ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:22.605298 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-611652cb-11c1-4d60-bc14-993b036230ce None None] MFA Rules not processed for user `e86e64a691c048e091ae6a23b5edf048`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:22.608442 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-611652cb-11c1-4d60-bc14-993b036230ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:22.718235 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1425/2867] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:22.722718 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faa988-8b9a-4cca-b99d-c24138ee6b6c service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:22.734362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faa988-8b9a-4cca-b99d-c24138ee6b6c service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:22.742778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461ae66-6e91-4f9e-b443-4920ebecaa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:22.743443 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461ae66-6e91-4f9e-b443-4920ebecaa2e admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:22.743775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461ae66-6e91-4f9e-b443-4920ebecaa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:22.744057 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461ae66-6e91-4f9e-b443-4920ebecaa2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:22.744761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461ae66-6e91-4f9e-b443-4920ebecaa2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:22.746786 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461ae66-6e91-4f9e-b443-4920ebecaa2e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:22.905856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1443/2868] 10.222.0.55 () {60 vars in 1153 bytes} [Mon Jul 25 23:17:22 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:17:22.920023 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611652cb-11c1-4d60-bc14-993b036230ce None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:22.932136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611652cb-11c1-4d60-bc14-993b036230ce None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:22.970829 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:22.995302 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a8071-9c7f-4352-a2e4-29c045c14ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:22.995926 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a8071-9c7f-4352-a2e4-29c045c14ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:22.996207 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a8071-9c7f-4352-a2e4-29c045c14ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:22.996481 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a8071-9c7f-4352-a2e4-29c045c14ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:22.997177 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a8071-9c7f-4352-a2e4-29c045c14ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:23.000010 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a8071-9c7f-4352-a2e4-29c045c14ba4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:23.134598 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1426/2869] 10.222.0.55 () {60 vars in 1144 bytes} [Mon Jul 25 23:17:22 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:17:23.135873 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461ae66-6e91-4f9e-b443-4920ebecaa2e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:23.151158 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461ae66-6e91-4f9e-b443-4920ebecaa2e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:23.162292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff706c-4e2b-4b0b-9dce-fff28862870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:23.162292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff706c-4e2b-4b0b-9dce-fff28862870c admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:23.162292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff706c-4e2b-4b0b-9dce-fff28862870c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:23.162292 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff706c-4e2b-4b0b-9dce-fff28862870c admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:23.162658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff706c-4e2b-4b0b-9dce-fff28862870c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:23.162658 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff706c-4e2b-4b0b-9dce-fff28862870c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:23.174051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1444/2870] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:17:23.178422 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a8071-9c7f-4352-a2e4-29c045c14ba4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:23.189417 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a8071-9c7f-4352-a2e4-29c045c14ba4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:23.194386 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff599bf3-f40f-42e9-bd7d-1851e1a5dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:23.195215 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff599bf3-f40f-42e9-bd7d-1851e1a5dfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:23.195510 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff599bf3-f40f-42e9-bd7d-1851e1a5dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:23.195841 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff599bf3-f40f-42e9-bd7d-1851e1a5dfc7 admin admin] PATH_INFO: `/v3/projects/0624d9dcd6044d5b842d3f90a8a10320/users/0a831baf202a4f128e5b2469bf44beca/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:23.220350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff599bf3-f40f-42e9-bd7d-1851e1a5dfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0624d9dcd6044d5b842d3f90a8a10320, user_id=0a831baf202a4f128e5b2469bf44beca, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:23.220350 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff599bf3-f40f-42e9-bd7d-1851e1a5dfc7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:23.297436 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1427/2871] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:17:23 2022] PUT /identity/v3/projects/0624d9dcd6044d5b842d3f90a8a10320/users/0a831baf202a4f128e5b2469bf44beca/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:23.302678 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff706c-4e2b-4b0b-9dce-fff28862870c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:23.315458 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff706c-4e2b-4b0b-9dce-fff28862870c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:23.336856 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:23.393579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c61562-e8df-47ed-bad0-c33ca4bb6748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:23.394632 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61562-e8df-47ed-bad0-c33ca4bb6748 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:23.394984 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61562-e8df-47ed-bad0-c33ca4bb6748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:23.395260 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61562-e8df-47ed-bad0-c33ca4bb6748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:23.395962 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c61562-e8df-47ed-bad0-c33ca4bb6748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:23.397617 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c61562-e8df-47ed-bad0-c33ca4bb6748 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:23.409517 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1445/2872] 10.222.0.55 () {58 vars in 1122 bytes} [Mon Jul 25 23:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:17:23.413698 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff599bf3-f40f-42e9-bd7d-1851e1a5dfc7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:23.425002 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff599bf3-f40f-42e9-bd7d-1851e1a5dfc7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:23.429595 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb523f73-3103-4581-8053-4e6f98e95657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:23.430268 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523f73-3103-4581-8053-4e6f98e95657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:23.430546 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523f73-3103-4581-8053-4e6f98e95657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:23.430818 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523f73-3103-4581-8053-4e6f98e95657 admin admin] PATH_INFO: `/v3/projects/0624d9dcd6044d5b842d3f90a8a10320/users/0a831baf202a4f128e5b2469bf44beca/roles/2fc9bc07a4f843ec8270a6b097a81ec1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:23.432775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb523f73-3103-4581-8053-4e6f98e95657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0624d9dcd6044d5b842d3f90a8a10320, user_id=0a831baf202a4f128e5b2469bf44beca, role_id=2fc9bc07a4f843ec8270a6b097a81ec1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:23.435681 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb523f73-3103-4581-8053-4e6f98e95657 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:23.450274 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1428/2873] 10.222.0.55 () {60 vars in 1483 bytes} [Mon Jul 25 23:17:23 2022] PUT /identity/v3/projects/0624d9dcd6044d5b842d3f90a8a10320/users/0a831baf202a4f128e5b2469bf44beca/roles/2fc9bc07a4f843ec8270a6b097a81ec1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:17:30.034273 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae66394-2a2c-4d8e-b9a1-61ba2fd21ae9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:30.034784 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae66394-2a2c-4d8e-b9a1-61ba2fd21ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:30.034888 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae66394-2a2c-4d8e-b9a1-61ba2fd21ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:30.064889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9ae66394-2a2c-4d8e-b9a1-61ba2fd21ae9 None None] MFA Rules not processed for user `0a831baf202a4f128e5b2469bf44beca`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:30.066271 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9ae66394-2a2c-4d8e-b9a1-61ba2fd21ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:30.138809 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1446/2874] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:30.152474 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb523f73-3103-4581-8053-4e6f98e95657 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:30.154786 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fb523f73-3103-4581-8053-4e6f98e95657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:30.228324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb523f73-3103-4581-8053-4e6f98e95657 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:30.234301 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378c8b-923c-4ae5-859f-e1d243671819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:30.234912 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378c8b-923c-4ae5-859f-e1d243671819 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:30.235190 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378c8b-923c-4ae5-859f-e1d243671819 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:30.235460 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378c8b-923c-4ae5-859f-e1d243671819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:30.296129 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf378c8b-923c-4ae5-859f-e1d243671819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:30.297802 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf378c8b-923c-4ae5-859f-e1d243671819 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:30.307628 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1429/2875] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:17:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:17:33.630862 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab7125-814b-45aa-9c67-2f52c1f2aed2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:33.631382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab7125-814b-45aa-9c67-2f52c1f2aed2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:33.631688 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab7125-814b-45aa-9c67-2f52c1f2aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:33.652359 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c7ab7125-814b-45aa-9c67-2f52c1f2aed2 None None] MFA Rules not processed for user `e86e64a691c048e091ae6a23b5edf048`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:17:33.654180 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c7ab7125-814b-45aa-9c67-2f52c1f2aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:33.661769 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1447/2876] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:17:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:17:40.303635 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:43.646604 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=57 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:53.127961 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378c8b-923c-4ae5-859f-e1d243671819 service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:17:53.129970 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cf378c8b-923c-4ae5-859f-e1d243671819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:53.200629 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378c8b-923c-4ae5-859f-e1d243671819 service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:17:53.206740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2afb29-1009-441a-ae75-0bc8dacd669c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:17:53.207353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2afb29-1009-441a-ae75-0bc8dacd669c service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:17:53.207636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2afb29-1009-441a-ae75-0bc8dacd669c service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:17:53.207905 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2afb29-1009-441a-ae75-0bc8dacd669c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:17:53.209676 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4b2afb29-1009-441a-ae75-0bc8dacd669c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:17:53.221337 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2afb29-1009-441a-ae75-0bc8dacd669c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:17:53.222917 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2afb29-1009-441a-ae75-0bc8dacd669c service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:17:53.232663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1430/2877] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:17:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:18:03.228525 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=32 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:18:09.459875 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab7125-814b-45aa-9c67-2f52c1f2aed2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:18:09.518406 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab7125-814b-45aa-9c67-2f52c1f2aed2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:18:09.522193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c870-7aa1-4641-b8da-db1199d0d603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:18:09.522818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c870-7aa1-4641-b8da-db1199d0d603 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:09.523097 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c870-7aa1-4641-b8da-db1199d0d603 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:09.523370 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c870-7aa1-4641-b8da-db1199d0d603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:09.533629 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9c870-7aa1-4641-b8da-db1199d0d603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:18:09.535098 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9c870-7aa1-4641-b8da-db1199d0d603 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:18:09.544794 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1448/2878] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:18:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:18:19.540404 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=26 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:19:04.067035 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a09ef-f18d-4ec8-af83-19650817c68c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:19:04.069565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a09ef-f18d-4ec8-af83-19650817c68c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:19:04.069565 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a09ef-f18d-4ec8-af83-19650817c68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:19:04.088134 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bb8a09ef-f18d-4ec8-af83-19650817c68c None None] MFA Rules not processed for user `c862a035745641b5a8dde92a3d570b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:19:04.090307 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bb8a09ef-f18d-4ec8-af83-19650817c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:19:04.158183 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1431/2879] 10.222.0.55 () {58 vars in 958 bytes} [Mon Jul 25 23:19:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:19:04.218758 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c870-7aa1-4641-b8da-db1199d0d603 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:19:04.221095 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-01f9c870-7aa1-4641-b8da-db1199d0d603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:19:04.288371 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c870-7aa1-4641-b8da-db1199d0d603 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:19:04.292226 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbd783-1e79-42da-b3f3-69074e9af2cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ccf6c1a5c044294a8eb83c877a6316e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:19:04.293066 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbd783-1e79-42da-b3f3-69074e9af2cf service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:19:04.293511 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbd783-1e79-42da-b3f3-69074e9af2cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:19:04.293909 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbd783-1e79-42da-b3f3-69074e9af2cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:19:04.296696 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2cbbd783-1e79-42da-b3f3-69074e9af2cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:19:04.313539 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbd783-1e79-42da-b3f3-69074e9af2cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:19:04.315008 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbd783-1e79-42da-b3f3-69074e9af2cf service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:19:04.327624 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1449/2880] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:19:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:19:05.374099 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a09ef-f18d-4ec8-af83-19650817c68c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:19:05.384166 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a09ef-f18d-4ec8-af83-19650817c68c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:19:05.388952 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f841-868a-470d-a01d-f2392bc8ca58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:19:05.389614 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f841-868a-470d-a01d-f2392bc8ca58 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:19:05.389894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f841-868a-470d-a01d-f2392bc8ca58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:19:05.390196 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f841-868a-470d-a01d-f2392bc8ca58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:19:05.392056 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6e22f841-868a-470d-a01d-f2392bc8ca58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:19:05.406805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22f841-868a-470d-a01d-f2392bc8ca58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:19:05.408288 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22f841-868a-470d-a01d-f2392bc8ca58 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:19:05.420116 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1432/2881] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:19:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:19:14.321248 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=26 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:19:15.414797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=31 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:19:22.014481 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbd783-1e79-42da-b3f3-69074e9af2cf service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:19:22.026031 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbd783-1e79-42da-b3f3-69074e9af2cf service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:19:22.032623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fc136-c55c-492b-a412-78b03de2269c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:19:22.033341 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc136-c55c-492b-a412-78b03de2269c service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:19:22.033621 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc136-c55c-492b-a412-78b03de2269c service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:19:22.033889 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc136-c55c-492b-a412-78b03de2269c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:19:22.035697 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9a7fc136-c55c-492b-a412-78b03de2269c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:19:22.046880 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fc136-c55c-492b-a412-78b03de2269c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:19:22.048547 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fc136-c55c-492b-a412-78b03de2269c service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:19:22.058256 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1450/2882] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:19:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:19:32.053488 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:06.607775 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f841-868a-470d-a01d-f2392bc8ca58 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:06.627345 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f841-868a-470d-a01d-f2392bc8ca58 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:06.630972 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dd5da-5f79-4604-9ff7-65b25adbb05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:06.631576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dd5da-5f79-4604-9ff7-65b25adbb05c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:06.631851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dd5da-5f79-4604-9ff7-65b25adbb05c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:06.632174 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dd5da-5f79-4604-9ff7-65b25adbb05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:06.634896 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-076dd5da-5f79-4604-9ff7-65b25adbb05c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:06.665491 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dd5da-5f79-4604-9ff7-65b25adbb05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:06.666963 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dd5da-5f79-4604-9ff7-65b25adbb05c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:06.675242 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1433/2883] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:20:16.671511 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=19 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:22.345051 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fc136-c55c-492b-a412-78b03de2269c service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:22.376251 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fc136-c55c-492b-a412-78b03de2269c service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:22.379877 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ff9d2-078b-49ec-b3ec-d4048d6b494f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:22.380498 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ff9d2-078b-49ec-b3ec-d4048d6b494f service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:22.380778 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ff9d2-078b-49ec-b3ec-d4048d6b494f service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:22.381055 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ff9d2-078b-49ec-b3ec-d4048d6b494f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:22.382850 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-984ff9d2-078b-49ec-b3ec-d4048d6b494f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:22.407011 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ff9d2-078b-49ec-b3ec-d4048d6b494f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:22.408451 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ff9d2-078b-49ec-b3ec-d4048d6b494f service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:22.416382 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1451/2884] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:20:23.522485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dd5da-5f79-4604-9ff7-65b25adbb05c service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:23.551789 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dd5da-5f79-4604-9ff7-65b25adbb05c service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:23.556324 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f4c3-34f1-49cb-abc5-41434191043b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:23.557277 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f4c3-34f1-49cb-abc5-41434191043b service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:23.558397 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f4c3-34f1-49cb-abc5-41434191043b service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:23.558855 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f4c3-34f1-49cb-abc5-41434191043b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:23.562809 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-91d8f4c3-34f1-49cb-abc5-41434191043b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:23.611650 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8f4c3-34f1-49cb-abc5-41434191043b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:23.613111 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8f4c3-34f1-49cb-abc5-41434191043b service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:23.622890 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ff9d2-078b-49ec-b3ec-d4048d6b494f service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:23.626107 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1434/2885] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:20:23.638073 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ff9d2-078b-49ec-b3ec-d4048d6b494f service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:23.644349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c348b-f705-4db7-a3fd-738478924e7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:23.644992 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c348b-f705-4db7-a3fd-738478924e7d service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:23.645311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c348b-f705-4db7-a3fd-738478924e7d service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:23.645592 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c348b-f705-4db7-a3fd-738478924e7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:23.647650 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2d6c348b-f705-4db7-a3fd-738478924e7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:23.661713 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c348b-f705-4db7-a3fd-738478924e7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:23.663349 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c348b-f705-4db7-a3fd-738478924e7d service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:23.676201 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1452/2886] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:20:33.621445 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=19 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:33.671243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=26 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:54.496063 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f4c3-34f1-49cb-abc5-41434191043b service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:54.498586 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-91d8f4c3-34f1-49cb-abc5-41434191043b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:54.514482 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f4c3-34f1-49cb-abc5-41434191043b service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:54.520278 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0067317-8dc0-4e17-b4dc-a90c885107bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:54.520908 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0067317-8dc0-4e17-b4dc-a90c885107bf service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:54.521269 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0067317-8dc0-4e17-b4dc-a90c885107bf service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:54.521739 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0067317-8dc0-4e17-b4dc-a90c885107bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:54.523870 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0067317-8dc0-4e17-b4dc-a90c885107bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:54.537373 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0067317-8dc0-4e17-b4dc-a90c885107bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:54.538992 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0067317-8dc0-4e17-b4dc-a90c885107bf service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:54.551878 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1435/2887] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:21:04.547083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=6 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:10.257533 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c348b-f705-4db7-a3fd-738478924e7d service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:21:10.259216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2d6c348b-f705-4db7-a3fd-738478924e7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:21:10.271914 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c348b-f705-4db7-a3fd-738478924e7d service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:21:10.275594 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb824c-d446-414d-bbc7-b9984e8a047f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cd52bd9f24f7d8ed93943aaaeaa9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:21:10.276210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb824c-d446-414d-bbc7-b9984e8a047f service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:10.276491 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb824c-d446-414d-bbc7-b9984e8a047f service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:10.276765 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb824c-d446-414d-bbc7-b9984e8a047f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:10.278602 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-53bb824c-d446-414d-bbc7-b9984e8a047f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:21:10.367192 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb824c-d446-414d-bbc7-b9984e8a047f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:21:10.368631 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb824c-d446-414d-bbc7-b9984e8a047f service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:21:10.387806 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1453/2888] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:21:13.735078 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0067317-8dc0-4e17-b4dc-a90c885107bf service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:21:13.751583 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0067317-8dc0-4e17-b4dc-a90c885107bf service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:21:13.752236 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873a3c7-659a-4b77-98bf-4f3e14d0c3d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:21:13.752872 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a3c7-659a-4b77-98bf-4f3e14d0c3d3 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:13.753357 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a3c7-659a-4b77-98bf-4f3e14d0c3d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:13.753615 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a3c7-659a-4b77-98bf-4f3e14d0c3d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:13.755420 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7873a3c7-659a-4b77-98bf-4f3e14d0c3d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:21:13.768033 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873a3c7-659a-4b77-98bf-4f3e14d0c3d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:21:13.769704 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873a3c7-659a-4b77-98bf-4f3e14d0c3d3 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:21:13.780304 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1436/2889] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:21:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:21:17.627332 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb824c-d446-414d-bbc7-b9984e8a047f service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:21:17.628818 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-53bb824c-d446-414d-bbc7-b9984e8a047f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:21:17.642896 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb824c-d446-414d-bbc7-b9984e8a047f service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:21:17.648791 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:21:17.649486 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:17.649774 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:17.650048 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] PATH_INFO: `/v3/users/c862a035745641b5a8dde92a3d570b35` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:17.651243 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c862a035745641b5a8dde92a3d570b35)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:21:17.653216 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:21:17.799485 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c862a035745641b5a8dde92a3d570b35'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:17.806446 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c862a035745641b5a8dde92a3d570b35'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:17.910967 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c862a035745641b5a8dde92a3d570b35'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:17.911542 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c862a035745641b5a8dde92a3d570b35'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:17.912187 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c862a035745641b5a8dde92a3d570b35'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:17.931362 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1454/2890] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:21:17 2022] DELETE /identity/v3/users/c862a035745641b5a8dde92a3d570b35 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:21:18.181179 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873a3c7-659a-4b77-98bf-4f3e14d0c3d3 service placement] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:21:18.192954 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873a3c7-659a-4b77-98bf-4f3e14d0c3d3 service placement] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:21:18.254707 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:21:18.255353 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:18.255636 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:18.255915 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] PATH_INFO: `/v3/projects/f661a74731894c6e94eced8d8f7520e7` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:18.257083 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f661a74731894c6e94eced8d8f7520e7)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:21:18.259150 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:21:18.350682 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f661a74731894c6e94eced8d8f7520e7', 'request_id': 'req-956f943a-1b31-47f7-9f2d-7880e2f3a16d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:18.357358 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f661a74731894c6e94eced8d8f7520e7', 'request_id': 'req-956f943a-1b31-47f7-9f2d-7880e2f3a16d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:18.419094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f661a74731894c6e94eced8d8f7520e7', 'request_id': 'req-956f943a-1b31-47f7-9f2d-7880e2f3a16d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:18.431485 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] The token cache is being invalidate because project f661a74731894c6e94eced8d8f7520e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:21:18.431701 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:18.432740 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:18.434477 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1437/2891] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:21:18 2022] DELETE /identity/v3/projects/f661a74731894c6e94eced8d8f7520e7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:21:18.438623 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:21:18.440104 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:21:18.453691 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980e730-3224-4115-9d21-7e357575fa3c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:21:18.489019 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:18.513052 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:21:18.513761 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:18.514045 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:18.514322 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] PATH_INFO: `/v3/users/5c6a3ea1dd7945d2841ecb0c0d022811` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:18.516430 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6a3ea1dd7945d2841ecb0c0d022811)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:21:18.519395 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:21:18.670393 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6a3ea1dd7945d2841ecb0c0d022811'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:18.679184 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6a3ea1dd7945d2841ecb0c0d022811'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:18.739588 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6a3ea1dd7945d2841ecb0c0d022811'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:18.740210 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6a3ea1dd7945d2841ecb0c0d022811'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:18.741750 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6a3ea1dd7945d2841ecb0c0d022811'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:18.759686 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1455/2892] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:21:18 2022] DELETE /identity/v3/users/5c6a3ea1dd7945d2841ecb0c0d022811 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:21:19.056761 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:21:19.057881 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:21:19.073347 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f943a-1b31-47f7-9f2d-7880e2f3a16d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:21:19.138143 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:21:19.138795 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:19.139090 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:19.139360 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] PATH_INFO: `/v3/projects/714b0679b7a64ad0b59fe821ba231723` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:19.141153 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714b0679b7a64ad0b59fe821ba231723)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:21:19.143136 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:21:19.165260 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:19.266846 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714b0679b7a64ad0b59fe821ba231723', 'request_id': 'req-c97340d2-7da2-4e96-ac7f-aa33e40371b4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:19.273047 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714b0679b7a64ad0b59fe821ba231723', 'request_id': 'req-c97340d2-7da2-4e96-ac7f-aa33e40371b4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:19.351213 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714b0679b7a64ad0b59fe821ba231723', 'request_id': 'req-c97340d2-7da2-4e96-ac7f-aa33e40371b4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:19.363544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] The token cache is being invalidate because project 714b0679b7a64ad0b59fe821ba231723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:21:19.363836 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:19.364494 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:21:19.366572 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1438/2893] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:21:19 2022] DELETE /identity/v3/projects/714b0679b7a64ad0b59fe821ba231723 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:21:28.756069 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:29.359094 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:59.099374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:21:59.101229 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:21:59.180710 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78482a06-7646-4dcb-895e-1516d16ccae4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:21:59.250103 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4390a84-e03a-48bf-9424-6301d08d42e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea60163008a4bea95d130a5809fc50d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:21:59.250654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390a84-e03a-48bf-9424-6301d08d42e0 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:59.250931 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390a84-e03a-48bf-9424-6301d08d42e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:59.251205 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390a84-e03a-48bf-9424-6301d08d42e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:59.254374 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e4390a84-e03a-48bf-9424-6301d08d42e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:21:59.266613 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4390a84-e03a-48bf-9424-6301d08d42e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:21:59.268206 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4390a84-e03a-48bf-9424-6301d08d42e0 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:21:59.281754 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1456/2894] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:21:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:22:05.321041 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:22:05.322710 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:22:05.401646 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97340d2-7da2-4e96-ac7f-aa33e40371b4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:22:05.406644 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a6380-d5a1-4d0c-aa29-7a264c9fe192 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:22:05.407267 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6380-d5a1-4d0c-aa29-7a264c9fe192 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:22:05.407576 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6380-d5a1-4d0c-aa29-7a264c9fe192 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:22:05.407856 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6380-d5a1-4d0c-aa29-7a264c9fe192 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:22:05.410007 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-464a6380-d5a1-4d0c-aa29-7a264c9fe192 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:22:05.422596 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a6380-d5a1-4d0c-aa29-7a264c9fe192 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:22:05.424216 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a6380-d5a1-4d0c-aa29-7a264c9fe192 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:22:05.435920 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1439/2895] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:22:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:22:09.275687 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=62 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:22:09.488152 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4390a84-e03a-48bf-9424-6301d08d42e0 service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:22:09.488579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e4390a84-e03a-48bf-9424-6301d08d42e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:22:09.559654 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4390a84-e03a-48bf-9424-6301d08d42e0 service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:22:09.564637 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:22:09.565582 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:22:09.565864 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:22:09.566139 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] PATH_INFO: `/v3/users/e86e64a691c048e091ae6a23b5edf048` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:22:09.567323 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86e64a691c048e091ae6a23b5edf048)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:22:09.569299 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:22:09.868775 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86e64a691c048e091ae6a23b5edf048'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:09.875646 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86e64a691c048e091ae6a23b5edf048'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:09.938854 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86e64a691c048e091ae6a23b5edf048'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:09.939643 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86e64a691c048e091ae6a23b5edf048'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:09.940311 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86e64a691c048e091ae6a23b5edf048'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:09.959942 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1457/2896] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:22:09 2022] DELETE /identity/v3/users/e86e64a691c048e091ae6a23b5edf048 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:22:10.209805 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a6380-d5a1-4d0c-aa29-7a264c9fe192 service placement] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:22:10.220875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a6380-d5a1-4d0c-aa29-7a264c9fe192 service placement] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:22:10.279820 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:22:10.280382 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:22:10.280663 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:22:10.280938 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] PATH_INFO: `/v3/projects/249b4da896194c73b9ef659a254dea52` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:22:10.282364 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=249b4da896194c73b9ef659a254dea52)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:22:10.284916 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:22:10.431341 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249b4da896194c73b9ef659a254dea52', 'request_id': 'req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:10.437444 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249b4da896194c73b9ef659a254dea52', 'request_id': 'req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:10.510544 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249b4da896194c73b9ef659a254dea52', 'request_id': 'req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:10.524188 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] The token cache is being invalidate because project 249b4da896194c73b9ef659a254dea52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:22:10.524600 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:10.525476 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:10.527058 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1440/2897] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:22:10 2022] DELETE /identity/v3/projects/249b4da896194c73b9ef659a254dea52 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:22:10.531287 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:22:10.532638 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:22:10.546840 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df65e4-86f6-4bde-9f1e-cd350189fdfb admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:22:10.605811 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:22:10.606465 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:22:10.606746 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:22:10.607023 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] PATH_INFO: `/v3/users/0a831baf202a4f128e5b2469bf44beca` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:22:10.608218 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a831baf202a4f128e5b2469bf44beca)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:22:10.610193 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:22:10.635289 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:22:10.914619 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a831baf202a4f128e5b2469bf44beca'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:10.922339 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a831baf202a4f128e5b2469bf44beca'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:11.020701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a831baf202a4f128e5b2469bf44beca'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:11.021739 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a831baf202a4f128e5b2469bf44beca'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:11.022579 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a831baf202a4f128e5b2469bf44beca'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:11.051044 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1458/2898] 10.222.0.55 () {58 vars in 1224 bytes} [Mon Jul 25 23:22:10 2022] DELETE /identity/v3/users/0a831baf202a4f128e5b2469bf44beca => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:22:11.312875 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:22:11.314473 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:22:11.327721 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b43a1-f2d4-43a4-8308-d8857b1fbc7c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:22:11.355091 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:22:11.388986 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5b24c5d3054270abb8dbb4d3ba574a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95854b83c1ee4dca86942110e1c80272', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:22:11.389668 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:22:11.390000 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:22:11.390333 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] PATH_INFO: `/v3/projects/0624d9dcd6044d5b842d3f90a8a10320` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:22:11.391462 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0624d9dcd6044d5b842d3f90a8a10320)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:22:11.394851 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:22:11.544120 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0624d9dcd6044d5b842d3f90a8a10320', 'request_id': 'req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:11.554797 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0624d9dcd6044d5b842d3f90a8a10320', 'request_id': 'req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:11.636139 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0624d9dcd6044d5b842d3f90a8a10320', 'request_id': 'req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:11.648224 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] The token cache is being invalidate because project 0624d9dcd6044d5b842d3f90a8a10320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:22:11.648512 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:11.649186 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b0e8b6ae-7fe1-409c-9655-cdc8716e3f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:22:11.650708 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1441/2899] 10.222.0.55 () {58 vars in 1233 bytes} [Mon Jul 25 23:22:11 2022] DELETE /identity/v3/projects/0624d9dcd6044d5b842d3f90a8a10320 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:22:21.044082 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:22:21.644894 dv-cinder-797608-63-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:23:08.849977 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:23:08.851448 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:23:08.947860 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442fb62-f382-4020-8273-ed72dde2063a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:23:09.010501 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8f624-d240-404a-946f-5cdb9aa09081 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa69689b82d4994beac3b698d40c37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f10d3e6c5c24ebabb0c7cde9794c47d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:23:09.011136 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8f624-d240-404a-946f-5cdb9aa09081 service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:23:09.011424 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8f624-d240-404a-946f-5cdb9aa09081 service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:23:09.011701 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8f624-d240-404a-946f-5cdb9aa09081 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:23:09.013549 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5db8f624-d240-404a-946f-5cdb9aa09081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:23:09.025330 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8f624-d240-404a-946f-5cdb9aa09081 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:23:09.026954 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8f624-d240-404a-946f-5cdb9aa09081 service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:23:09.038167 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1459/2900] 10.222.0.55 () {60 vars in 1365 bytes} [Mon Jul 25 23:23:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:23:19.033093 dv-cinder-797608-63-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=67 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}